Jul 03 17:17:36 devstack cinder-volume[75381]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 17:17:36 devstack cinder-volume[75381]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 17:17:36 devstack cinder-volume[75381]: we strongly recommend against using it for new projects. Jul 03 17:17:36 devstack cinder-volume[75381]: If you are already using Eventlet, we recommend migrating to a different Jul 03 17:17:36 devstack cinder-volume[75381]: framework. For more detail see Jul 03 17:17:36 devstack cinder-volume[75381]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 17:17:36 devstack cinder-volume[75381]: import eventlet # noqa Jul 03 17:17:38 devstack cinder-volume[75381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:17:38 devstack cinder-volume[75381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:17:38 devstack cinder-volume[75381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:17:39 devstack cinder-volume[75381]: INFO dbcounter [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Registered counter for database cinder Jul 03 17:17:39 devstack cinder-volume[75381]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG dbcounter [-] [75381] Writer thread running {{(pid=75381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.rpc [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.rpc [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.volume.manager [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Determined volume DB was empty at startup. Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG cinder.volume.manager [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75381) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.volume.manager [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 17:17:40 devstack cinder-volume[75381]: WARNING stevedore.named [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 17:17:40 devstack cinder-volume[75381]: WARNING castellan.key_manager [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:17:40 devstack cinder-volume[75381]: WARNING cinder.keymgr.conf_key_mgr [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG cinder.volume.drivers.lvm [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75381) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG oslo_concurrency.processutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75381) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG oslo_concurrency.processutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] CMD "cinder-rtstool verify" returned: 0 in 0.475s {{(pid=75381) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.rpc [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.rpc [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 17:17:40 devstack cinder-volume[75381]: WARNING stevedore.named [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 17:17:40 devstack cinder-volume[75381]: WARNING castellan.key_manager [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:17:40 devstack cinder-volume[75381]: INFO cinder.volume.manager [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 17:17:40 devstack cinder-volume[75381]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:17:41 devstack cinder-volume[75381]: INFO oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Starting 1 workers Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Started child 75554 {{(pid=75381) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Full set of CONF: {{(pid=75381) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] ******************************************************************************** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Configuration options gathered from: {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] ================================================================================ {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] allow_availability_zone_fallback = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75554]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] allow_compression_on_image_upload = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] allowed_direct_url_schemes = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] api_rate_limit = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] auth_strategy = keystone {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] az_cache_duration = 3600 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_availability_zone = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_host = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_stats_polling_interval = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backup_api_class = cinder.backup.api.API {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backup_name_template = backup-%s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backup_use_same_host = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backup_use_temp_snapshot = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] chap_password = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] chap_username = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_internal_tenant_project_id = af82080d395b464a93abf204ec72fb78 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_internal_tenant_user_id = d495e22f369e47389259abd2aed8160f {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cloned_volume_same_az = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cluster = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] compression_format = gzip {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] compute_api_class = cinder.compute.nova.API {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] config_dir = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] config_source = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] control_exchange = openstack {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] debug = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] default_availability_zone = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] default_group_type = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] default_volume_type = lvmdriver-1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] disk_geometry = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] driver_client_cert = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] driver_client_cert_key = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] driver_data_namespace = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] driver_ssl_cert_path = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] driver_ssl_cert_verify = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] driver_use_ssl = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] enable_force_upload = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] enable_new_services = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] enable_unsupported_driver = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] enforce_multipath_for_image_xfer = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] filter_function = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_api_insecure = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_api_ssl_compression = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_ca_certificates_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_catalog_info = image:glance:publicURL {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_num_retries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack sudo[75558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance_request_timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] goodness_function = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] graceful_shutdown_timeout = 5 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] group_api_class = cinder.group.api.API {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] host = devstack {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_compress_on_upload = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_conversion_address_space_limit = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack sudo[75558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_conversion_cpu_limit = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_conversion_disable = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_upload_use_cinder_backend = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_upload_use_internal_tenant = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_volume_cache_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_volume_cache_max_count = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] image_volume_cache_max_size_gb = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] init_host_max_objects_retrieval = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] instance_format = [instance: %(uuid)s] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] iscsi_target_flags = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] iscsi_write_cache = on {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] iser_helper = tgtadm {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] iser_ip_address = 192.168.122.21 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] iser_port = 3260 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_color = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_config_append = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_dir = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_options = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_rotate_interval = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_rotate_interval_type = days {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] log_rotation_type = none {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] max_age = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] max_logfile_count = 30 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] max_logfile_size_mb = 200 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] max_over_subscription_ratio = 20.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] message_reap_interval = 86400 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] message_ttl = 2592000 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] migration_create_volume_timeout_secs = 300 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] monkey_patch = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] monkey_patch_modules = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] my_ip = 192.168.122.21 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] no_snapshot_gb_quota = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] num_iser_scan_tries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] num_shell_tries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] num_volume_device_scan_tries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] nvmeof_conn_info_version = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] nvmet_ns_id = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] nvmet_port_id = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_max_limit = 1000 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_volume_ext_list = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_volume_listen_port = 8776 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_volume_use_ssl = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] osapi_volume_workers = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] per_volume_size_limit = -1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] periodic_fuzzy_delay = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] periodic_interval = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] public_endpoint = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] publish_errors = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_backup_gigabytes = 1000 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_backups = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_gigabytes = 1000 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_groups = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_snapshots = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] quota_volumes = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] rate_limit_burst = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] rate_limit_except_level = CRITICAL {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] rate_limit_interval = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] reinit_driver_count = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] replication_device = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] report_discard_supported = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] report_interval = 120 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] reservation_clean_interval = 86400 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] reservation_expire = 86400 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] reserved_image_namespaces = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] reserved_percentage = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] rpc_response_timeout = 120 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] run_external_periodic_tasks = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] scst_target_driver = iscsi {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] scst_target_iqn_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_down_time = 720 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] shell_completion = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] snapshot_name_template = snapshot-%s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] snapshot_same_host = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] split_loggers = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] state_path = /opt/stack/data/cinder {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] storage_availability_zone = nova {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] storage_protocol = iSCSI {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] syslog_log_facility = LOG_USER {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] target_helper = lioadm {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] target_ip_address = 192.168.122.21 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] target_port = 3260 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] target_protocol = iscsi {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] target_secondary_ip_addresses = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] trace_flags = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] transport_url = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] until_refresh = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_chap_auth = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_default_quota_class = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_journal = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_json = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_multipath_for_image_xfer = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_stderr = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] use_syslog = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] verify_glance_signatures = enabled {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_api_class = cinder.volume.api.API {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_backend_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_clear = zero {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_clear_ionice = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_clear_size = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_copy_bps_limit = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_dd_blocksize = 1M {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_name_template = volume-%s {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_service_inithost_offload = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volume_usage_audit_period = month {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] zoning_mode = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_concurrency.disable_process_locking = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.auth_section = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.auth_type = password {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.auth_version = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.cache = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.include_service_catalog = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.insecure = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.interface = public {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_password = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcache_username = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.region_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.service_type = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.backend = dogpile.cache.null {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.backend_argument = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.backend_expiration_time = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.config_prefix = cache.oslo {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.debug_cache_backend = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.enable_retry_client = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.enable_socket_keepalive = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.expiration_time = 600 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.hashclient_retry_attempts = 2 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_dead_retry = 300 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_pool_maxsize = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_sasl_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.password = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.proxies = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.redis_db = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.redis_server = localhost:6379 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.retry_attempts = 2 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.retry_delay = 0.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.socket_keepalive_count = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.socket_keepalive_idle = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.socket_keepalive_interval = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.socket_timeout = 1.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.tls_allowed_ciphers = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.tls_cafile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.tls_certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.tls_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.tls_keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cache.username = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] coordination.backend_url = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.asyncio_connection = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.asyncio_slave_connection = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.backend = sqlalchemy {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.connection = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.connection_debug = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.connection_parameters = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.connection_recycle_time = 3600 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.connection_trace = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.db_inc_retry_interval = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.db_max_retries = 20 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.db_max_retry_interval = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.db_retry_interval = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.max_overflow = 50 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.max_pool_size = 5 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.max_retries = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.mysql_wsrep_sync_wait = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.pool_timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.retry_interval = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.slave_connection = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.sqlite_synchronous = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.synchronous_reader = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] database.use_db_reconnect = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.connection_string = messaging:// {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.es_doc_type = notification {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.es_scroll_size = 10000 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.es_scroll_time = 2m {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.filter_error_trace = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.hmac_keys = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.sentinel_service_name = mymaster {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.socket_timeout = 0.1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.trace_requests = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler.trace_sqlalchemy = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler_jaeger.process_tags = {} {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler_jaeger.service_name_prefix = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] profiler_otlp.service_name_prefix = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.enforce_new_defaults = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.enforce_scope = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.policy_default_rule = default {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.policy_file = policy.yaml {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.group = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.helper_command = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] privsep_osbrick.user = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.group = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.helper_command = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] cinder_sys_admin.user = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.auth_section = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.auth_type = password {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.cafile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.collect_timing = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.insecure = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.send_service_user_token = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.split_loggers = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] service_user.timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.auth_section = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.auth_type = password {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.collect_timing = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.insecure = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.region_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.split_loggers = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] glance.timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.backend_availability_zone = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.chap_password = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.chap_username = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.disk_geometry = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.driver_client_cert = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.driver_client_cert_key = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.driver_data_namespace = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.driver_use_ssl = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.extra_capabilities = {} {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.filter_function = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.goodness_function = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.iscsi_target_flags = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.iscsi_write_cache = on {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.iser_helper = tgtadm {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.iser_port = 3260 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.lvm_share_target = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.lvm_type = auto {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.num_shell_tries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.replication_device = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.report_discard_supported = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.reserved_percentage = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.target_helper = tgtadm {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.target_port = 3260 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.target_protocol = iscsi {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.trace_flags = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.unique_fqdn_network = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.use_chap_auth = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_backend_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_clear = zero {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_clear_ionice = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_clear_size = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_reports.file_event_handler = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_reports.log_dir = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.backend_host = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.chap_password = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.chap_username = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.disk_geometry = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.driver_client_cert = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.extra_capabilities = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.filter_function = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.goodness_function = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.iser_helper = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.iser_ip_address = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.iser_port = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.lvm_share_target = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.lvm_type = auto {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.num_shell_tries = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.replication_device = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.report_discard_supported = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.reserved_percentage = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.scst_target_driver = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.storage_protocol = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.target_helper = lioadm {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.target_ip_address = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.target_port = 3260 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.trace_flags = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.use_chap_auth = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_clear = zero {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_clear_size = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] lvmdriver-1.volumes_dir = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_notifications.driver = [] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_notifications.retry = -1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] key_manager.fixed_key = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.barbican_api_version = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.barbican_endpoint = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.barbican_endpoint_type = public {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.barbican_region_name = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.cafile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.collect_timing = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.insecure = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.number_of_retries = 60 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.retry_delay = 1 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.send_service_user_token = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.split_loggers = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.verify_ssl = True {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican.verify_ssl_path = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.auth_section = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.auth_type = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.cafile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.certfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.collect_timing = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.insecure = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.keyfile = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.split_loggers = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] barbican_service_user.timeout = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.approle_role_id = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.approle_secret_id = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.kv_mountpoint = secret {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.kv_path = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.kv_version = 2 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.namespace = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.root_token_id = **** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.ssl_ca_crt_file = None {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.timeout = 60.0 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.use_ssl = False {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:17:41 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] ******************************************************************************** {{(pid=75381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 17:17:42 devstack sudo[75558]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.866s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:42 devstack sudo[75788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:42 devstack sudo[75788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:42 devstack sudo[75788]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.744s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:17:42 devstack cinder-volume[75554]: INFO cinder.brick.local_dev.lvm [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:42 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:42 devstack sudo[76055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:17:42 devstack sudo[76055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:43 devstack sudo[76055]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:43 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.802s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:43 devstack cinder-volume[75554]: DEBUG cinder.brick.local_dev.lvm [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75554) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 17:17:43 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:43 devstack sudo[76198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:43 devstack sudo[76198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:44 devstack sudo[76198]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:44 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.207s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:44 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:44 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:44 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:44 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:44 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:45 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:45 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.785s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:45 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:45 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:45 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:45 devstack sudo[76331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 17:17:45 devstack sudo[76331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:46 devstack sudo[76331]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:46 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.689s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:46 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:46 devstack sudo[76334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:17:46 devstack sudo[76334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:47 devstack sudo[76334]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:47 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.748s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:47 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:47 devstack sudo[76345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:17:47 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:47 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:47 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:47 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:47 devstack sudo[76350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:47 devstack sudo[76350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:48 devstack sudo[76350]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:48 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.872s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:48 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:48 devstack sudo[76353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:48 devstack sudo[76353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:49 devstack sudo[76353]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:49 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:49 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:49 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:49 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:49 devstack sudo[76357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:49 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:50 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.795s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:50 devstack cinder-volume[75554]: INFO cinder.volume.drivers.lvm [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:50 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:50 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:50 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.699s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Updating volume stats {{(pid=75554) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 17:17:50 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:50 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:17:50 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:51 devstack cinder-volume[75381]: DEBUG dbcounter [-] [75381] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:17:51 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:51 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:51 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:51 devstack sudo[76625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:51 devstack sudo[76625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:52 devstack sudo[76625]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:52 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:52 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:52 devstack sudo[76628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:52 devstack sudo[76628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:52 devstack sudo[76628]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:52 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:52 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:52 devstack sudo[76631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:52 devstack sudo[76631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:53 devstack sudo[76631]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:53 devstack cinder-volume[75554]: INFO cinder.volume.driver [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG cinder.volume.driver [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75554) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG oslo_db.sqlalchemy.engines [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writer thread running {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG cinder.db.api [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Building query based on filter {{(pid=75554) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG cinder.image.image_utils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75554) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 17:17:53 devstack cinder-volume[75554]: INFO cinder.keymgr.migration [None req-58d4557a-c3dc-4e0a-98c4-13a28b980961 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Updating volume stats {{(pid=75554) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 17:17:53 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:53 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:17:53 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:54 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:54 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:54 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:54 devstack sudo[76640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:54 devstack sudo[76640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:55 devstack sudo[76640]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:55 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:55 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:55 devstack sudo[76646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:55 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:55 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:55 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:55 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:55 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:55 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:56 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:56 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:56 devstack cinder-volume[75554]: DEBUG cinder.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Notifying Schedulers of capabilities ... {{(pid=75554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:17:56 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Driver initialization completed successfully. Jul 03 17:17:56 devstack cinder-volume[75554]: INFO cinder.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Initiating service 2 cleanup Jul 03 17:17:56 devstack cinder-volume[75554]: INFO cinder.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Service 2 cleanup completed. Jul 03 17:17:56 devstack cinder-volume[75554]: DEBUG cinder.service [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Creating RPC server for service cinder-volume {{(pid=75554) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 17:17:56 devstack cinder-volume[75554]: DEBUG cinder.service [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75554) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 17:17:56 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 17:17:56 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Updating volume stats {{(pid=75554) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 17:17:56 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:56 devstack sudo[76653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:17:56 devstack sudo[76653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:57 devstack sudo[76653]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:57 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:57 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:57 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:57 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:57 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:57 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:57 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:57 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:17:57 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:58 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:58 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:58 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:17:58 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:17:58 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:17:59 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Jul 03 17:17:59 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:17:59 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-3affa8ef-a414-40ec-ba33-5aad70e2acd5 None None] Driver post RPC initialization completed successfully. Jul 03 17:18:06 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:18:09 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:18:28 devstack cinder-volume[75554]: DEBUG oslo_service.periodic_task [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running periodic task VolumeManager._thread_info {{(pid=75554) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:18:28 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] thread count: 6 {{(pid=75554) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:18:28 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] thread info: [<_MainThread(MainThread, started 136172008374400)>, , , , , ] {{(pid=75554) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:19:28 devstack cinder-volume[75554]: DEBUG oslo_service.periodic_task [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75554) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:19:28 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Updating volume stats {{(pid=75554) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 17:19:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:19:28 devstack sudo[79305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:19:28 devstack sudo[79305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:19:28 devstack sudo[79305]: pam_unix(sudo:session): session closed for user root Jul 03 17:19:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:19:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:19:28 devstack sudo[79745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:19:28 devstack sudo[79745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:19:29 devstack sudo[79745]: pam_unix(sudo:session): session closed for user root Jul 03 17:19:29 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:19:29 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:19:29 devstack sudo[80198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:19:29 devstack sudo[80198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:19:30 devstack sudo[80198]: pam_unix(sudo:session): session closed for user root Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:19:30 devstack sudo[80616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:19:30 devstack sudo[80616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:19:30 devstack sudo[80616]: pam_unix(sudo:session): session closed for user root Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG cinder.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Notifying Schedulers of capabilities ... {{(pid=75554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG oslo_service.periodic_task [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running periodic task VolumeManager._thread_info {{(pid=75554) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] thread count: 6 {{(pid=75554) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:19:30 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] thread info: [<_MainThread(MainThread, started 136172008374400)>, , , , , ] {{(pid=75554) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:20:09 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:20:28 devstack cinder-volume[75554]: DEBUG oslo_service.periodic_task [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75554) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:20:28 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Updating volume stats {{(pid=75554) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 17:20:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:20:28 devstack sudo[82929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:20:28 devstack sudo[82929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:20:28 devstack sudo[82929]: pam_unix(sudo:session): session closed for user root Jul 03 17:20:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:20:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:20:28 devstack sudo[82962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:20:28 devstack sudo[82962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:20:29 devstack sudo[82962]: pam_unix(sudo:session): session closed for user root Jul 03 17:20:29 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:20:29 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:20:29 devstack sudo[82994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:20:29 devstack sudo[82994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:20:30 devstack sudo[82994]: pam_unix(sudo:session): session closed for user root Jul 03 17:20:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.763s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:20:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:20:30 devstack sudo[83015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:20:30 devstack sudo[83015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:20:31 devstack sudo[83015]: pam_unix(sudo:session): session closed for user root Jul 03 17:20:31 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:20:31 devstack cinder-volume[75554]: DEBUG cinder.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Notifying Schedulers of capabilities ... {{(pid=75554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:20:31 devstack cinder-volume[75554]: DEBUG oslo_service.periodic_task [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running periodic task VolumeManager._thread_info {{(pid=75554) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:20:31 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] thread count: 6 {{(pid=75554) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:20:31 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] thread info: [<_MainThread(MainThread, started 136172008374400)>, , , , , ] {{(pid=75554) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:21:28 devstack cinder-volume[75554]: DEBUG oslo_service.periodic_task [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75554) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:21:28 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Updating volume stats {{(pid=75554) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 17:21:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:21:28 devstack sudo[84478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 17:21:28 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:21:28 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root Jul 03 17:21:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:21:28 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:21:28 devstack sudo[84492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:21:28 devstack sudo[84492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:21:29 devstack sudo[84492]: pam_unix(sudo:session): session closed for user root Jul 03 17:21:29 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:21:29 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:21:29 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 17:21:29 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:21:30 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Jul 03 17:21:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:21:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:21:30 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 17:21:30 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:21:30 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Jul 03 17:21:30 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:21:30 devstack cinder-volume[75554]: DEBUG cinder.manager [None req-73e39a06-b1d8-446f-b1d8-fa212cdacdd2 None None] Notifying Schedulers of capabilities ... {{(pid=75554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:22:09 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:22:18 devstack cinder-volume[75381]: INFO oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Caught SIGTERM, stopping children Jul 03 17:22:18 devstack cinder-volume[75381]: DEBUG oslo_concurrency.lockutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Acquiring lock "singleton_lock" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:22:18 devstack cinder-volume[75381]: DEBUG oslo_concurrency.lockutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Acquired lock "singleton_lock" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:22:18 devstack cinder-volume[75381]: DEBUG oslo_concurrency.lockutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Releasing lock "singleton_lock" {{(pid=75381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:22:18 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Stop services. {{(pid=75381) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 17:22:18 devstack cinder-volume[75381]: DEBUG oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Killing children. {{(pid=75381) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 17:22:18 devstack cinder-volume[75381]: INFO oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Waiting on 1 children to exit Jul 03 17:22:21 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Acquiring lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:22:21 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Acquired lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:22:21 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Releasing lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:22:21 devstack cinder-volume[75554]: WARNING amqp [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 17:22:21 devstack cinder-volume[75554]: WARNING amqp [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 17:22:21 devstack cinder-volume[75381]: INFO oslo_service.backend._eventlet.service [None req-ce1fd2bd-37a2-4ba3-a0b9-c2a8eec07f73 None None] Child 75554 exited with status 0 Jul 03 17:22:21 devstack cinder-volume[85662]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 17:22:21 devstack cinder-volume[85662]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 17:22:21 devstack cinder-volume[85662]: we strongly recommend against using it for new projects. Jul 03 17:22:21 devstack cinder-volume[85662]: If you are already using Eventlet, we recommend migrating to a different Jul 03 17:22:21 devstack cinder-volume[85662]: framework. For more detail see Jul 03 17:22:21 devstack cinder-volume[85662]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 17:22:21 devstack cinder-volume[85662]: import eventlet # noqa Jul 03 17:22:24 devstack cinder-volume[85662]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:22:24 devstack cinder-volume[85662]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:22:24 devstack cinder-volume[85662]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:22:24 devstack cinder-volume[85662]: INFO dbcounter [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Registered counter for database cinder Jul 03 17:22:24 devstack cinder-volume[85662]: DEBUG oslo_db.sqlalchemy.engines [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG dbcounter [-] [85662] Writer thread running {{(pid=85662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 17:22:25 devstack cinder-volume[85662]: INFO cinder.rpc [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 17:22:25 devstack cinder-volume[85662]: INFO cinder.rpc [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_db.sqlalchemy.engines [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:25 devstack cinder-volume[85662]: INFO cinder.volume.manager [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Determined volume DB was empty at startup. Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG cinder.volume.manager [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85662) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 17:22:25 devstack cinder-volume[85662]: INFO cinder.volume.manager [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 17:22:25 devstack cinder-volume[85662]: WARNING stevedore.named [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 17:22:25 devstack cinder-volume[85662]: WARNING castellan.key_manager [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:22:25 devstack cinder-volume[85662]: WARNING cinder.keymgr.conf_key_mgr [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:22:25 devstack cinder-volume[85662]: INFO cinder.volume.manager [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_db.sqlalchemy.engines [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:25 devstack cinder-volume[85662]: INFO oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Starting 1 workers Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Started child 85879 {{(pid=85662) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Full set of CONF: {{(pid=85662) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] ******************************************************************************** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Configuration options gathered from: {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] ================================================================================ {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] allow_availability_zone_fallback = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] allow_compression_on_image_upload = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] allowed_direct_url_schemes = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] api_rate_limit = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] auth_strategy = keystone {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_availability_zone = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_host = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_stats_polling_interval = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backup_api_class = cinder.backup.api.API {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backup_name_template = backup-%s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backup_use_same_host = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backup_use_temp_snapshot = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] chap_password = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] chap_username = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_internal_tenant_project_id = af82080d395b464a93abf204ec72fb78 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_internal_tenant_user_id = d495e22f369e47389259abd2aed8160f {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cluster = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] compression_format = gzip {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] compute_api_class = cinder.compute.nova.API {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] config_dir = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] config_source = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] control_exchange = openstack {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] debug = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85879]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] default_availability_zone = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] default_group_type = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] default_volume_type = QuobyteHD {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] disk_geometry = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] driver_client_cert = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] driver_client_cert_key = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] driver_data_namespace = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] driver_ssl_cert_path = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] driver_ssl_cert_verify = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] driver_use_ssl = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] enable_new_services = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] enable_unsupported_driver = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] enabled_backends = ['QuobyteHD'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] enforce_multipath_for_image_xfer = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] filter_function = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_api_insecure = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_api_ssl_compression = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_ca_certificates_file = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_catalog_info = image:glance:publicURL {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_num_retries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance_request_timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] goodness_function = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] graceful_shutdown_timeout = 5 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] group_api_class = cinder.group.api.API {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] host = devstack {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_compress_on_upload = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_conversion_address_space_limit = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_conversion_cpu_limit = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_conversion_disable = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_upload_use_cinder_backend = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_upload_use_internal_tenant = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_volume_cache_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_volume_cache_max_count = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] image_volume_cache_max_size_gb = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] init_host_max_objects_retrieval = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] instance_format = [instance: %(uuid)s] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] iscsi_target_flags = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] iscsi_write_cache = on {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] iser_helper = tgtadm {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] iser_ip_address = 192.168.122.21 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] iser_port = 3260 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_color = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_config_append = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_dir = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_file = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_options = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_rotate_interval = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_rotate_interval_type = days {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] log_rotation_type = none {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] max_age = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] max_logfile_count = 30 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] max_logfile_size_mb = 200 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] max_over_subscription_ratio = 20.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] message_reap_interval = 86400 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] message_ttl = 2592000 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] migration_create_volume_timeout_secs = 300 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] monkey_patch = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] monkey_patch_modules = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] my_ip = 192.168.122.21 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] no_snapshot_gb_quota = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] num_iser_scan_tries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] num_shell_tries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] num_volume_device_scan_tries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] nvmeof_conn_info_version = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] nvmet_ns_id = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] nvmet_port_id = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_max_limit = 1000 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_volume_ext_list = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_volume_listen = 0.0.0.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_volume_listen_port = 8776 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_volume_use_ssl = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] osapi_volume_workers = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] per_volume_size_limit = -1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] periodic_fuzzy_delay = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] periodic_interval = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] project_id_regex = [0-9a-f\-]+ {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] public_endpoint = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] publish_errors = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_backup_gigabytes = 1000 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_backups = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_gigabytes = 1000 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_groups = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_snapshots = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] quota_volumes = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] rate_limit_burst = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] rate_limit_except_level = CRITICAL {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] rate_limit_interval = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] reinit_driver_count = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] replication_device = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] report_discard_supported = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] report_interval = 120 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] reservation_clean_interval = 86400 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] reservation_expire = 86400 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] reserved_image_namespaces = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] reserved_percentage = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] rpc_response_timeout = 120 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] run_external_periodic_tasks = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] scst_target_driver = iscsi {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] scst_target_iqn_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_down_time = 720 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] shell_completion = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] snapshot_name_template = snapshot-%s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] split_loggers = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] state_path = /opt/stack/data/cinder {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] storage_availability_zone = nova {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] storage_protocol = iSCSI {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] syslog_log_facility = LOG_USER {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] target_helper = lioadm {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] target_ip_address = 192.168.122.21 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] target_port = 3260 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] target_protocol = iscsi {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] target_secondary_ip_addresses = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] trace_flags = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] transfer_api_class = cinder.transfer.api.API {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.remotefs [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85879) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] transport_url = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] until_refresh = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_chap_auth = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_default_quota_class = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_journal = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_json = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_multipath_for_image_xfer = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_stderr = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] use_syslog = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] verify_glance_signatures = enabled {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_api_class = cinder.volume.api.API {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_backend_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_clear = zero {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_clear_ionice = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_clear_size = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_copy_bps_limit = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_dd_blocksize = 1M {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_name_template = volume-%s {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_service_inithost_offload = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volume_usage_audit_period = month {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] zoning_mode = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_concurrency.disable_process_locking = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.auth_section = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.auth_type = password {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.auth_version = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.cache = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.delay_auth_decision = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.http_connect_timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.include_service_catalog = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.insecure = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.interface = public {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_password = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcache_username = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.region_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.service_token_roles_required = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.service_type = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.token_cache_time = 300 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.backend = dogpile.cache.null {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.backend_argument = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.backend_expiration_time = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.config_prefix = cache.oslo {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.debug_cache_backend = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.enable_retry_client = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.enable_socket_keepalive = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.expiration_time = 600 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.hashclient_retry_attempts = 2 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_dead_retry = 300 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_pool_maxsize = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_sasl_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.password = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.proxies = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.redis_db = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.redis_sentinel_service_name = mymaster {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.redis_server = localhost:6379 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.retry_attempts = 2 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.retry_delay = 0.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.socket_keepalive_count = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.socket_keepalive_idle = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.socket_keepalive_interval = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.socket_timeout = 1.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.tls_allowed_ciphers = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.tls_cafile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.tls_certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.tls_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.tls_keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cache.username = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] coordination.backend_url = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.asyncio_connection = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.asyncio_slave_connection = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.backend = sqlalchemy {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.connection = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.connection_debug = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.connection_parameters = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.connection_recycle_time = 3600 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.connection_trace = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.db_inc_retry_interval = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.db_max_retries = 20 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.db_max_retry_interval = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.db_retry_interval = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.max_overflow = 50 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.max_pool_size = 5 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.max_retries = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.mysql_wsrep_sync_wait = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.pool_timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.retry_interval = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.slave_connection = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.sqlite_synchronous = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.synchronous_reader = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] database.use_db_reconnect = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.connection_string = messaging:// {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.es_doc_type = notification {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.es_scroll_size = 10000 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.es_scroll_time = 2m {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.filter_error_trace = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.hmac_keys = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.sentinel_service_name = mymaster {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.socket_timeout = 0.1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.trace_requests = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler.trace_sqlalchemy = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler_jaeger.process_tags = {} {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler_jaeger.service_name_prefix = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] profiler_otlp.service_name_prefix = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.enforce_new_defaults = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.enforce_scope = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.policy_default_rule = default {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.policy_file = policy.yaml {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_policy.remote_timeout = 60.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.group = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.helper_command = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] privsep_osbrick.user = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.group = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.helper_command = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] cinder_sys_admin.user = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.auth_section = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.auth_type = password {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.cafile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.collect_timing = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.insecure = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.send_service_user_token = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.split_loggers = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] service_user.timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.auth_section = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.auth_type = password {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.collect_timing = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.insecure = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.region_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.split_loggers = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] glance.timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.backend_availability_zone = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.chap_password = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.chap_username = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.disk_geometry = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.driver_client_cert = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.driver_client_cert_key = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.driver_data_namespace = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.driver_use_ssl = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.enable_unsupported_driver = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.extra_capabilities = {} {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.filter_function = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.goodness_function = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.iscsi_target_flags = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.iscsi_write_cache = on {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.iser_helper = tgtadm {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.iser_port = 3260 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85879) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 17:22:25 devstack cinder-volume[85879]: WARNING cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 17:22:25 devstack cinder-volume[85879]: WARNING cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_host = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_login = admin {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_mount_options = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Running cmd (subprocess): mount.quobyte {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_password = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_private_key = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_share_path = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_ssh_port = 22 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.num_shell_tries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.nvmet_port_id = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_client_cfg = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.quobyte_volume_url = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.replication_device = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.report_discard_supported = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.reserved_percentage = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.scst_target_driver = iscsi {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.scst_target_iqn_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.storage_protocol = iSCSI {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.target_helper = tgtadm {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.target_port = 3260 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.target_protocol = iscsi {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.trace_flags = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.unique_fqdn_network = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.use_chap_auth = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_backend_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_clear = zero {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_clear_ionice = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_clear_size = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_reports.file_event_handler = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_reports.log_dir = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.backend_availability_zone = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.backend_host = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.chap_password = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.chap_username = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.chiscsi_conf = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.disk_geometry = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.driver_client_cert = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.driver_client_cert_key = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.driver_data_namespace = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.driver_use_ssl = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.extra_capabilities = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.filter_function = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.goodness_function = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.iscsi_target_flags = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.iscsi_write_cache = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.iser_helper = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.iser_ip_address = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.iser_port = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.iser_target_prefix = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_host = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_login = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_mount_options = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_password = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_private_key = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_share_path = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_ssh_port = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.num_shell_tries = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nvmet_ns_id = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.nvmet_port_id = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.replication_device = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.report_discard_supported = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.reserved_percentage = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.scst_target_driver = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.storage_protocol = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.target_helper = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.target_ip_address = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.target_port = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.target_prefix = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.target_protocol = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.trace_flags = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.unique_fqdn_network = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.use_chap_auth = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack quobyte-client[85880]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 17:22:25 devstack quobyte-client[85880]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_clear = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_clear_ionice = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_clear_size = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] QuobyteHD.volumes_dir = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: INFO cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 ... Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 -c /etc/quobyte/client-cinder.cfg {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.ssl_version = {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_notifications.driver = [] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_notifications.retry = -1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] oslo_messaging_notifications.transport_url = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] key_manager.fixed_key = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.barbican_api_version = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.barbican_endpoint = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.barbican_endpoint_type = public {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.barbican_region_name = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.cafile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.collect_timing = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.insecure = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.number_of_retries = 60 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.retry_delay = 1 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.send_service_user_token = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.split_loggers = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.verify_ssl = True {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican.verify_ssl_path = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.auth_section = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.auth_type = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.cafile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.certfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.collect_timing = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.insecure = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.keyfile = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.split_loggers = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] barbican_service_user.timeout = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.approle_role_id = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.approle_secret_id = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.kv_mountpoint = secret {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.kv_path = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.kv_version = 2 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.namespace = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.root_token_id = **** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.ssl_ca_crt_file = None {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.timeout = 60.0 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.use_ssl = False {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:25 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] ******************************************************************************** {{(pid=85662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 17:22:25 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 -c /etc/quobyte/client-cinder.cfg Jul 03 17:22:25 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:26 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.800s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:26 devstack cinder-volume[85879]: INFO cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 succeeded Jul 03 17:22:26 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.821s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:26 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:26 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:26 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:27 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.649s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:27 devstack cinder-volume[85879]: INFO cinder.volume.driver [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG cinder.volume.driver [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7351341247559, 'free_capacity_gb': 1775.7351341247559, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85879) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG oslo_db.sqlalchemy.engines [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG dbcounter [-] [85879] Writer thread running {{(pid=85879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG cinder.db.api [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Building query based on filter {{(pid=85879) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG cinder.image.image_utils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85879) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 17:22:27 devstack cinder-volume[85879]: INFO cinder.keymgr.migration [None req-eb3c80a0-122c-4c94-b0f6-afa2b5c725bb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:27 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:27 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:27 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:28 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.623s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG cinder.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Notifying Schedulers of capabilities ... {{(pid=85879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:22:28 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Driver initialization completed successfully. Jul 03 17:22:28 devstack cinder-volume[85879]: INFO cinder.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Initiating service 3 cleanup Jul 03 17:22:28 devstack cinder-volume[85879]: INFO cinder.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Service 3 cleanup completed. Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG cinder.service [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Creating RPC server for service cinder-volume {{(pid=85879) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG cinder.service [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85879) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 17:22:28 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:28 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:28 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:28 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:28 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:29 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.787s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:29 devstack cinder-volume[85879]: INFO cinder.volume.manager [None req-54c5569a-687a-401f-ab9e-1f239264a777 None None] Driver post RPC initialization completed successfully. Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=85879) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG cinder.volume.drivers.quobyte [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=85879) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85879) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:33 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:33 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:33 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG oslo_concurrency.processutils [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.587s {{(pid=85879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:33 devstack cinder-volume[85879]: DEBUG cinder.manager [None req-deef4cbc-ba8b-49e8-b679-8e4da8fbc6d5 None None] Notifying Schedulers of capabilities ... {{(pid=85879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:22:35 devstack cinder-volume[85662]: DEBUG dbcounter [-] [85662] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:22:36 devstack cinder-volume[85662]: INFO oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Caught SIGTERM, stopping children Jul 03 17:22:36 devstack cinder-volume[85662]: DEBUG oslo_concurrency.lockutils [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Acquiring lock "singleton_lock" {{(pid=85662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:22:36 devstack cinder-volume[85662]: DEBUG oslo_concurrency.lockutils [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Acquired lock "singleton_lock" {{(pid=85662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:22:36 devstack cinder-volume[85662]: DEBUG oslo_concurrency.lockutils [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Releasing lock "singleton_lock" {{(pid=85662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:22:36 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Stop services. {{(pid=85662) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 17:22:36 devstack cinder-volume[85662]: DEBUG oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Killing children. {{(pid=85662) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 17:22:36 devstack cinder-volume[85662]: INFO oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Waiting on 1 children to exit Jul 03 17:22:39 devstack cinder-volume[85879]: DEBUG dbcounter [-] [85879] Writing DB stats cinder:SELECT=4 {{(pid=85879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:22:39 devstack cinder-volume[85879]: DEBUG dbcounter [-] [85879] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:22:41 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Acquiring lock "singleton_lock" {{(pid=85879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:22:41 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Acquired lock "singleton_lock" {{(pid=85879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:22:41 devstack cinder-volume[85879]: DEBUG oslo_concurrency.lockutils [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Releasing lock "singleton_lock" {{(pid=85879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:22:41 devstack cinder-volume[85879]: WARNING amqp [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 17:22:41 devstack cinder-volume[85879]: WARNING amqp [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 17:22:41 devstack cinder-volume[85662]: INFO oslo_service.backend._eventlet.service [None req-24a29440-4595-44ab-8aee-98d6e5b6010b None None] Child 85879 exited with status 0 Jul 03 17:22:42 devstack cinder-volume[86363]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 17:22:42 devstack cinder-volume[86363]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 17:22:42 devstack cinder-volume[86363]: we strongly recommend against using it for new projects. Jul 03 17:22:42 devstack cinder-volume[86363]: If you are already using Eventlet, we recommend migrating to a different Jul 03 17:22:42 devstack cinder-volume[86363]: framework. For more detail see Jul 03 17:22:42 devstack cinder-volume[86363]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 17:22:42 devstack cinder-volume[86363]: import eventlet # noqa Jul 03 17:22:45 devstack cinder-volume[86363]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 17:22:45 devstack cinder-volume[86363]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 17:22:45 devstack cinder-volume[86363]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 17:22:45 devstack cinder-volume[86363]: INFO dbcounter [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Registered counter for database cinder Jul 03 17:22:45 devstack cinder-volume[86363]: DEBUG oslo_db.sqlalchemy.engines [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG dbcounter [-] [86363] Writer thread running {{(pid=86363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 17:22:46 devstack cinder-volume[86363]: INFO cinder.rpc [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 17:22:46 devstack cinder-volume[86363]: INFO cinder.rpc [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_db.sqlalchemy.engines [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:46 devstack cinder-volume[86363]: INFO cinder.volume.manager [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Determined volume DB was empty at startup. Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG cinder.volume.manager [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86363) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 17:22:46 devstack cinder-volume[86363]: WARNING stevedore.named [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 17:22:46 devstack cinder-volume[86363]: WARNING castellan.key_manager [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:22:46 devstack cinder-volume[86363]: WARNING cinder.keymgr.conf_key_mgr [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 17:22:46 devstack cinder-volume[86363]: INFO cinder.volume.manager [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_db.sqlalchemy.engines [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:46 devstack cinder-volume[86363]: INFO oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Starting 1 workers Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Started child 86621 {{(pid=86363) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Full set of CONF: {{(pid=86363) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] ******************************************************************************** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] Configuration options gathered from: {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] ================================================================================ {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] allow_availability_zone_fallback = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] allow_compression_on_image_upload = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] allowed_direct_url_schemes = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] api_rate_limit = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] auth_strategy = keystone {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86621]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_availability_zone = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_host = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_stats_polling_interval = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backup_api_class = cinder.backup.api.API {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backup_name_template = backup-%s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backup_use_same_host = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backup_use_temp_snapshot = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] chap_password = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] chap_username = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_internal_tenant_project_id = af82080d395b464a93abf204ec72fb78 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_internal_tenant_user_id = d495e22f369e47389259abd2aed8160f {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cluster = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] compression_format = gzip {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] compute_api_class = cinder.compute.nova.API {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] config_dir = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] config_source = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] control_exchange = openstack {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] debug = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] default_availability_zone = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] default_group_type = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] default_volume_type = QuobyteHD {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] disk_geometry = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] driver_client_cert = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] driver_client_cert_key = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] driver_data_namespace = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] driver_ssl_cert_path = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] driver_ssl_cert_verify = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] driver_use_ssl = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] enable_new_services = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] enable_unsupported_driver = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] enabled_backends = ['QuobyteHD'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] enforce_multipath_for_image_xfer = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] filter_function = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_api_insecure = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_api_ssl_compression = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_ca_certificates_file = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_catalog_info = image:glance:publicURL {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_num_retries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance_request_timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] goodness_function = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] graceful_shutdown_timeout = 5 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] group_api_class = cinder.group.api.API {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] host = devstack {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_compress_on_upload = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_conversion_address_space_limit = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_conversion_cpu_limit = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_conversion_disable = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_upload_use_cinder_backend = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_upload_use_internal_tenant = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_volume_cache_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_volume_cache_max_count = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] image_volume_cache_max_size_gb = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] init_host_max_objects_retrieval = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] instance_format = [instance: %(uuid)s] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] iscsi_target_flags = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] iscsi_write_cache = on {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] iser_helper = tgtadm {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] iser_ip_address = 192.168.122.21 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] iser_port = 3260 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_color = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_config_append = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_dir = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_file = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_options = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_rotate_interval = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_rotate_interval_type = days {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] log_rotation_type = none {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] max_age = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] max_logfile_count = 30 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] max_logfile_size_mb = 200 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] max_over_subscription_ratio = 20.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] message_reap_interval = 86400 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] message_ttl = 2592000 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] migration_create_volume_timeout_secs = 300 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] monkey_patch = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] monkey_patch_modules = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] my_ip = 192.168.122.21 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] no_snapshot_gb_quota = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] num_iser_scan_tries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] num_shell_tries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] num_volume_device_scan_tries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86621) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] nvmeof_conn_info_version = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] nvmet_ns_id = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] nvmet_port_id = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_max_limit = 1000 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_volume_ext_list = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_volume_listen_port = 8776 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_volume_use_ssl = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] osapi_volume_workers = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] per_volume_size_limit = -1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] periodic_fuzzy_delay = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] periodic_interval = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] public_endpoint = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] publish_errors = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_backup_gigabytes = 1000 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_backups = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_gigabytes = 1000 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_groups = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_snapshots = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] quota_volumes = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] rate_limit_burst = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] rate_limit_except_level = CRITICAL {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] rate_limit_interval = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] reinit_driver_count = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] replication_device = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] report_discard_supported = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] report_interval = 120 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] reservation_clean_interval = 86400 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] reservation_expire = 86400 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] reserved_image_namespaces = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] reserved_percentage = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] rpc_response_timeout = 120 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] run_external_periodic_tasks = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] scst_target_driver = iscsi {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] scst_target_iqn_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_down_time = 720 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] shell_completion = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] snapshot_name_template = snapshot-%s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] split_loggers = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] state_path = /opt/stack/data/cinder {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] storage_availability_zone = nova {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] storage_protocol = iSCSI {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] syslog_log_facility = LOG_USER {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] target_helper = lioadm {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] target_ip_address = 192.168.122.21 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] target_port = 3260 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] target_protocol = iscsi {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] target_secondary_ip_addresses = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] trace_flags = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] transport_url = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] until_refresh = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_chap_auth = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_default_quota_class = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_journal = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_json = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_multipath_for_image_xfer = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_stderr = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] use_syslog = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] verify_glance_signatures = enabled {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_api_class = cinder.volume.api.API {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_backend_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_clear = zero {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_clear_ionice = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_clear_size = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_copy_bps_limit = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_dd_blocksize = 1M {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_name_template = volume-%s {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_service_inithost_offload = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volume_usage_audit_period = month {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] zoning_mode = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_concurrency.disable_process_locking = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.auth_section = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.auth_type = password {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.auth_version = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.cache = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.include_service_catalog = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.insecure = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.interface = public {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_password = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcache_username = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.region_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.service_type = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.backend = dogpile.cache.null {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.backend_argument = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.backend_expiration_time = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.config_prefix = cache.oslo {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.debug_cache_backend = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.enable_retry_client = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.enable_socket_keepalive = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.expiration_time = 600 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.hashclient_retry_attempts = 2 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_dead_retry = 300 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86621) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_pool_maxsize = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_sasl_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.password = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.proxies = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.redis_db = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.redis_server = localhost:6379 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.retry_attempts = 2 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.retry_delay = 0.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.socket_keepalive_count = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.socket_keepalive_idle = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.socket_keepalive_interval = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.socket_timeout = 1.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.tls_allowed_ciphers = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.tls_cafile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.tls_certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Running cmd (subprocess): mount.quobyte {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.tls_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.tls_keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cache.username = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] coordination.backend_url = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.asyncio_connection = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.asyncio_slave_connection = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.backend = sqlalchemy {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.connection = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.connection_debug = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.connection_parameters = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.connection_recycle_time = 3600 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.connection_trace = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.db_inc_retry_interval = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.db_max_retries = 20 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.db_max_retry_interval = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.db_retry_interval = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.max_overflow = 50 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.max_pool_size = 5 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.max_retries = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.mysql_wsrep_sync_wait = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.pool_timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.retry_interval = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.slave_connection = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.sqlite_synchronous = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.synchronous_reader = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] database.use_db_reconnect = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.connection_string = messaging:// {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.es_doc_type = notification {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.es_scroll_size = 10000 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.es_scroll_time = 2m {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.filter_error_trace = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.hmac_keys = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.sentinel_service_name = mymaster {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.socket_timeout = 0.1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.trace_requests = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler.trace_sqlalchemy = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler_jaeger.process_tags = {} {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler_jaeger.service_name_prefix = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] profiler_otlp.service_name_prefix = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.enforce_new_defaults = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.enforce_scope = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.policy_default_rule = default {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.policy_file = policy.yaml {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.group = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.helper_command = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] privsep_osbrick.user = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.group = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.helper_command = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] cinder_sys_admin.user = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.auth_section = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.auth_type = password {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.cafile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.collect_timing = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.insecure = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.send_service_user_token = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.split_loggers = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] service_user.timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.auth_section = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.auth_type = password {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.collect_timing = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.insecure = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.region_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.split_loggers = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] glance.timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.backend_availability_zone = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.chap_password = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.chap_username = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.disk_geometry = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.driver_client_cert = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.driver_client_cert_key = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.driver_data_namespace = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.driver_use_ssl = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.extra_capabilities = {} {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.filter_function = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.goodness_function = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack quobyte-client[86650]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.iscsi_target_flags = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack quobyte-client[86650]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.iscsi_write_cache = on {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.iser_helper = tgtadm {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.iser_port = 3260 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_host = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_login = admin {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_mount_options = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_password = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_private_key = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_share_path = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.num_shell_tries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.quobyte_volume_url = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.replication_device = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.report_discard_supported = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.reserved_percentage = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.target_helper = tgtadm {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.target_port = 3260 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.target_protocol = iscsi {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.trace_flags = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.unique_fqdn_network = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.use_chap_auth = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_backend_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_clear = zero {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_clear_ionice = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_clear_size = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_reports.file_event_handler = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_reports.log_dir = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.backend_availability_zone = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.backend_host = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.chap_password = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.chap_username = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.chiscsi_conf = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.disk_geometry = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.driver_client_cert = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.driver_data_namespace = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.driver_use_ssl = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.extra_capabilities = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.filter_function = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.goodness_function = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.iser_helper = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.iser_ip_address = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.iser_port = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.iser_target_prefix = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_host = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_login = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_mount_options = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_password = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_private_key = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_share_path = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_ssh_port = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.num_shell_tries = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.nvmet_port_id = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.replication_device = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.report_discard_supported = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.reserved_percentage = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.scst_target_driver = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.storage_protocol = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.target_helper = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.target_ip_address = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.target_port = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.target_prefix = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.target_protocol = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.trace_flags = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.use_chap_auth = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_clear = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_clear_size = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] QuobyteHD.volumes_dir = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_notifications.driver = [] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_notifications.retry = -1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] key_manager.fixed_key = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.barbican_api_version = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.barbican_endpoint = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.barbican_endpoint_type = public {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.barbican_region_name = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.cafile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.collect_timing = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.insecure = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.number_of_retries = 60 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.retry_delay = 1 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.send_service_user_token = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.split_loggers = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.verify_ssl = True {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican.verify_ssl_path = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.auth_section = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.auth_type = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.cafile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.certfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.collect_timing = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.insecure = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.keyfile = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.split_loggers = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] barbican_service_user.timeout = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.approle_role_id = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.approle_secret_id = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.kv_mountpoint = secret {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.kv_path = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.kv_version = 2 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.namespace = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.root_token_id = **** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.ssl_ca_crt_file = None {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.timeout = 60.0 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.use_ssl = False {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 17:22:46 devstack cinder-volume[86363]: DEBUG oslo_service.backend._eventlet.service [None req-4c4ef8d9-9a2d-4d31-89df-dd0c61b3be4a None None] ******************************************************************************** {{(pid=86363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 17:22:47 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:47 devstack cinder-volume[86621]: INFO cinder.volume.driver [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Driver hasn't implemented _init_vendor_properties() Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.volume.driver [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7351341247559, 'free_capacity_gb': 1775.7351341247559, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86621) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_db.sqlalchemy.engines [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writer thread running {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.db.api [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Building query based on filter {{(pid=86621) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86621) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:47 devstack cinder-volume[86621]: INFO cinder.keymgr.migration [None req-05100ed7-33be-4e49-9f5b-e6199d87476b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 17:22:47 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:47 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:47 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:22:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Driver initialization completed successfully. Jul 03 17:22:47 devstack cinder-volume[86621]: INFO cinder.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Initiating service 3 cleanup Jul 03 17:22:47 devstack cinder-volume[86621]: INFO cinder.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Service 3 cleanup completed. Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.service [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Creating RPC server for service cinder-volume {{(pid=86621) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 17:22:47 devstack cinder-volume[86621]: DEBUG cinder.service [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86621) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 17:22:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:22:48 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:22:48 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:22:48 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Jul 03 17:22:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.611s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:22:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-55ec2146-9538-4583-b9d3-cfbee5bcdeee None None] Driver post RPC initialization completed successfully. Jul 03 17:22:56 devstack cinder-volume[86363]: DEBUG dbcounter [-] [86363] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:22:57 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:22:58 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:23:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:23:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 6 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:23:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Flow 'volume_create_manager' (d4f77e46-1e68-4a29-b6fe-12a733ef4ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e870b454-a413-434f-9d0d-8551bd8ccae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e870b454-a413-434f-9d0d-8551bd8ccae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-85564678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea324f5-ba7a-4902-a9fd-c8a79779e0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bce46a629144de8c231f10533d9008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:24:15Z,use_quota=True,user_id='b486232a287c4b14a127fe508e05585f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cf44b4-4f77-41df-83af-4f66d21b2740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cf44b4-4f77-41df-83af-4f66d21b2740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e638711-4d9f-4d0e-809c-edb28f83a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e638711-4d9f-4d0e-809c-edb28f83a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea324f5-ba7a-4902-a9fd-c8a79779e0e9', 'volume_name': 'volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b40f8-28b7-4cdb-9e37-f2fa233c5caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b40f8-28b7-4cdb-9e37-f2fa233c5caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355b0789-ce62-4b5b-92fd-8f18a05845ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Volume dea324f5-ba7a-4902-a9fd-c8a79779e0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9', 'volume_size': 1} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-85564678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea324f5-ba7a-4902-a9fd-c8a79779e0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bce46a629144de8c231f10533d9008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:24:15Z,use_quota=True,user_id='b486232a287c4b14a127fe508e05585f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Creating volume dea324f5-ba7a-4902-a9fd-c8a79779e0e9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:24:15 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:24:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:15 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 1073741824 Jul 03 17:24:15 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Flow 'volume_create_manager' (2e4daf0e-f175-417f-87f7-0b687f9b9348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e774a17-34cf-486d-9e67-d4bfb95cc93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e774a17-34cf-486d-9e67-d4bfb95cc93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-511807774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fa653d-0eff-4605-8437-4cae251a24d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc94d95faef94ca0a773767fed842776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:24:16Z,use_quota=True,user_id='a5e584f217a247449608627a40cab0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee54773c-acc9-4275-877f-a3ddb3b8f0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee54773c-acc9-4275-877f-a3ddb3b8f0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b549f0fc-f413-4adb-be0c-fd340afb4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b549f0fc-f413-4adb-be0c-fd340afb4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fa653d-0eff-4605-8437-4cae251a24d5', 'volume_name': 'volume-49fa653d-0eff-4605-8437-4cae251a24d5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4936a3f-acd2-4458-acc9-c1fcc51e1705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4936a3f-acd2-4458-acc9-c1fcc51e1705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac753d78-bb9d-4ee5-852e-d25e1d63ba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Volume 49fa653d-0eff-4605-8437-4cae251a24d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fa653d-0eff-4605-8437-4cae251a24d5', 'volume_size': 1} Jul 03 17:24:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:17 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 1073741824" returned: 0 in 2.293s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:18 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 Jul 03 17:24:18 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:20 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" returned: 0 in 1.951s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] <== create_volume: return (4361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.368s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-511807774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fa653d-0eff-4605-8437-4cae251a24d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc94d95faef94ca0a773767fed842776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:24:16Z,use_quota=True,user_id='a5e584f217a247449608627a40cab0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Creating volume 49fa653d-0eff-4605-8437-4cae251a24d5 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:24:20 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355b0789-ce62-4b5b-92fd-8f18a05845ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1258c2d7-18fd-4f05-b5fc-d8770372e2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:20 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 1073741824 Jul 03 17:24:20 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:20 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Volume volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 (dea324f5-ba7a-4902-a9fd-c8a79779e0e9): created successfully Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1258c2d7-18fd-4f05-b5fc-d8770372e2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Flow 'volume_create_manager' (d4f77e46-1e68-4a29-b6fe-12a733ef4ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:24:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-697e3865-073b-4574-98ea-b36b3c0630f1 tempest-DeleteServersTestJSON-2105115722 None] Created volume successfully. Jul 03 17:24:22 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 1073741824" returned: 0 in 2.148s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:22 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 Jul 03 17:24:22 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:23 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:24:23 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Flow 'volume_create_manager' (b9f88fe2-5df6-4b76-a490-01072b505b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:24:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b514a32-7538-4bec-b774-cc36bf92bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5" returned: 0 in 1.524s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] <== create_volume: return (3785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:24:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.791s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b514a32-7538-4bec-b774-cc36bf92bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1686661298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8911f84f-cfeb-42eb-b368-9b95c45e78a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772fb3c0c1454e458c8345bc61bc7de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:24:24Z,use_quota=True,user_id='3449375a3a8547aa9d0243ba674088a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12273dea-96d2-4952-8cbd-06689d5ccdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12273dea-96d2-4952-8cbd-06689d5ccdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d00a4f-9783-465a-bf44-9039357b6ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d00a4f-9783-465a-bf44-9039357b6ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8911f84f-cfeb-42eb-b368-9b95c45e78a5', 'volume_name': 'volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3109bf34-f2ac-40a4-aee5-5b5c2730eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3109bf34-f2ac-40a4-aee5-5b5c2730eba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e15d0a-7d11-4d33-ae61-ba5b6c940deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Volume 8911f84f-cfeb-42eb-b368-9b95c45e78a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5', 'volume_size': 1} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1686661298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8911f84f-cfeb-42eb-b368-9b95c45e78a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772fb3c0c1454e458c8345bc61bc7de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:24:24Z,use_quota=True,user_id='3449375a3a8547aa9d0243ba674088a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Creating volume 8911f84f-cfeb-42eb-b368-9b95c45e78a5 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:24:24 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:24 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 1073741824 Jul 03 17:24:24 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac753d78-bb9d-4ee5-852e-d25e1d63ba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fa653d-0eff-4605-8437-4cae251a24d5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54b037-fbd7-4343-a644-20b780e8530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Volume volume-49fa653d-0eff-4605-8437-4cae251a24d5 (49fa653d-0eff-4605-8437-4cae251a24d5): created successfully Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54b037-fbd7-4343-a644-20b780e8530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Flow 'volume_create_manager' (2e4daf0e-f175-417f-87f7-0b687f9b9348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:24:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6e365a57-fe14-4410-81d6-2f4f54ba7abb tempest-VolumesAdminNegativeTest-1490991556 None] Created volume successfully. Jul 03 17:24:25 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 1073741824" returned: 0 in 1.461s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:25 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 Jul 03 17:24:25 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Acquiring lock "cinder-49fa653d-0eff-4605-8437-4cae251a24d5-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:24:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Lock "cinder-49fa653d-0eff-4605-8437-4cae251a24d5-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:24:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Acquiring lock "cinder-quobyte-49fa653d-0eff-4605-8437-4cae251a24d5" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:24:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Lock "cinder-quobyte-49fa653d-0eff-4605-8437-4cae251a24d5" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:24:26 devstack cinder-volume[86621]: INFO oslo.privsep.daemon [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6xkqb4p2/privsep.sock'] Jul 03 17:24:26 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6xkqb4p2/privsep.sock Jul 03 17:24:26 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:27 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5" returned: 0 in 1.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] <== create_volume: return (3420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.422s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e15d0a-7d11-4d33-ae61-ba5b6c940deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48fca12-e52e-4cdb-8914-ce35784e777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:24:27 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Volume volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 (8911f84f-cfeb-42eb-b368-9b95c45e78a5): created successfully Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48fca12-e52e-4cdb-8914-ce35784e777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:24:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Flow 'volume_create_manager' (b9f88fe2-5df6-4b76-a490-01072b505b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:24:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c79a0c24-fac1-4fa5-8d40-cce9480bcd2b tempest-ServerRescueNegativeTestJSON-1613532613 None] Created volume successfully. Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 17:24:28 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 17:24:29 devstack cinder-volume[86621]: WARNING py.warnings [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 03 17:24:29 devstack cinder-volume[86621]: .first() Jul 03 17:24:29 devstack cinder-volume[86621]: Jul 03 17:24:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 17:24:30 devstack cinder-volume[86621]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 17:24:31 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:31 devstack cinder-volume[86621]: INFO oslo.privsep.daemon [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Spawned new privsep daemon via rootwrap Jul 03 17:24:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Accepted privsep connection to /tmp/tmp6xkqb4p2/privsep.sock {{(pid=86621) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 17:24:31 devstack cinder-volume[86621]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 17:24:31 devstack cinder-volume[86621]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 17:24:31 devstack cinder-volume[86621]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 17:24:31 devstack cinder-volume[86621]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87714 Jul 03 17:24:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5734a0d6-1902-4145-9f96-bdc5e48f6d39]: (2,) {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:24:31 devstack cinder-volume[86621]: WARNING oslo_privsep.priv_context [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] privsep daemon already running Jul 03 17:24:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[463facd1-2ba4-4dcb-86d5-ef054a6c482f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:24:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6ac7e-d3ef-476a-babf-4750cc764fb6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:24:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:31 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 Jul 03 17:24:31 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:31 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 Jul 03 17:24:31 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:32 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" returned: 0 in 1.482s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.843s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60300d3f-3796-41e1-9aee-dffcd3ecf877', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:24:33 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5" returned: 0 in 1.911s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-d14f1e18-bfd3-4687-a92b-591a937e8666 req-347d06b2-90d1-4d51-afca-051a07c7ec8c tempest-DeleteServersTestJSON-2105115722 None] attachment_update completed successfully. Jul 03 17:24:33 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5 Jul 03 17:24:33 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:34 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49fa653d-0eff-4605-8437-4cae251a24d5" returned: 0 in 1.505s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Lock "cinder-quobyte-49fa653d-0eff-4605-8437-4cae251a24d5" released by "delete_volume" :: held 8.020s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:24:34 devstack cinder-volume[86621]: WARNING cinder.quota [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:24:34 devstack cinder-volume[86621]: WARNING cinder.quota [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:24:34 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Created reservations ['ff34a421-e83d-4c90-ba36-b124dfe8a80b', '82dcbf5f-7082-4d6c-8d02-5f75b52085c8', '00ea357f-8b93-4386-bdc1-36e8fba694d7', '2224159c-a1c5-42c8-833f-f5a9b2f2a2d9'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:24:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:24:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:24:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:35 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:24:35 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:36 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.990s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:36 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:24:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Deleted volume successfully. Jul 03 17:24:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c42a8641-5c6d-42c2-bc94-aaa515755073 tempest-VolumesAdminNegativeTest-1490991556 None] Lock "cinder-49fa653d-0eff-4605-8437-4cae251a24d5-delete_volume" released by "delete_volume" :: held 9.566s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:43 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:24:43 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:45 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=17,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:24:45 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.413s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:24:45 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:24:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 8 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:24:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:24:46 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:24:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-f1705301-d796-4e5b-9e2f-3ebaefa39d0d req-03588640-858c-4ff4-bbc4-f67812ec2a28 tempest-DeleteServersTestJSON-2105115722 None] Terminate volume connection completed successfully. Jul 03 17:24:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-f1705301-d796-4e5b-9e2f-3ebaefa39d0d req-03588640-858c-4ff4-bbc4-f67812ec2a28 tempest-DeleteServersTestJSON-2105115722 None] Deleting attachment 60300d3f-3796-41e1-9aee-dffcd3ecf877. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:24:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Acquiring lock "cinder-dea324f5-ba7a-4902-a9fd-c8a79779e0e9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:24:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Lock "cinder-dea324f5-ba7a-4902-a9fd-c8a79779e0e9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:24:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Acquiring lock "cinder-quobyte-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:24:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Lock "cinder-quobyte-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:24:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226fce5-feb1-4c27-93c4-ac7ce657e0cd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:24:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:53 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 Jul 03 17:24:53 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:54 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" returned: 0 in 1.371s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:54 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9 Jul 03 17:24:54 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:55 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" returned: 0 in 0.899s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Lock "cinder-quobyte-dea324f5-ba7a-4902-a9fd-c8a79779e0e9" released by "delete_volume" :: held 2.343s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Created reservations ['14c960c3-a9a7-4b42-b62f-a82c45070676', '9613a1d1-6fd3-4aac-a8f3-6a44e9bd1edf', '9ae27d19-ea52-47a9-a4e1-e43843b37b56', 'b6439734-c38f-449d-83f9-aab16d870b22'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:24:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:24:55 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:24:55 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:24:56 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Jul 03 17:24:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.897s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:24:56 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:24:56 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Deleted volume successfully. Jul 03 17:24:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c04654dd-3a7e-4c2a-8b97-e66e6207799d tempest-DeleteServersTestJSON-2105115722 None] Lock "cinder-dea324f5-ba7a-4902-a9fd-c8a79779e0e9-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:25:05 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:25:06 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:25:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Acquiring lock "cinder-8911f84f-cfeb-42eb-b368-9b95c45e78a5-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:25:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "cinder-8911f84f-cfeb-42eb-b368-9b95c45e78a5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:25:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Acquiring lock "cinder-quobyte-8911f84f-cfeb-42eb-b368-9b95c45e78a5" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:25:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "cinder-quobyte-8911f84f-cfeb-42eb-b368-9b95c45e78a5" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:25:07 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7b35df-da16-4ada-bd20-daab85797233]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:25:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:07 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 Jul 03 17:25:07 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:08 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5" returned: 0 in 1.000s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:08 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5 Jul 03 17:25:08 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:09 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8911f84f-cfeb-42eb-b368-9b95c45e78a5" returned: 0 in 1.280s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "cinder-quobyte-8911f84f-cfeb-42eb-b368-9b95c45e78a5" released by "delete_volume" :: held 2.345s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Created reservations ['b153866c-529a-46f5-acb5-ab5d32c31ecc', '4b922f3f-88c9-4025-9cb4-9ad078a01e48', '93b1c9e5-7cfb-4e48-ad2a-6188c7ff8b27', '7f876b15-87f3-47bc-b700-848362823551'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:09 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:25:09 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Flow 'volume_create_manager' (22ccf744-bb3c-4fb0-aad8-fea2481005e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d20a305-5130-459f-9667-e5940f5b1996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d20a305-5130-459f-9667-e5940f5b1996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-713737247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f48671-ef14-4f4d-8236-6e04d28bcc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2fe6b2e5a94e4aaea62175d6797c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:25:10Z,use_quota=True,user_id='479fc139131d48e8939b02993fe05f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aef571b-6d50-4e58-b753-e250fc400e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aef571b-6d50-4e58-b753-e250fc400e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaa98db-b759-49f6-aaaf-58490493ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaa98db-b759-49f6-aaaf-58490493ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f48671-ef14-4f4d-8236-6e04d28bcc6c', 'volume_name': 'volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12157e2-48af-4a33-91f5-3facb7564178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12157e2-48af-4a33-91f5-3facb7564178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c16a45-2b55-4b21-93f7-1a706b815e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Volume 88f48671-ef14-4f4d-8236-6e04d28bcc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c', 'volume_size': 1} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-713737247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f48671-ef14-4f4d-8236-6e04d28bcc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2fe6b2e5a94e4aaea62175d6797c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:25:10Z,use_quota=True,user_id='479fc139131d48e8939b02993fe05f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Creating volume 88f48671-ef14-4f4d-8236-6e04d28bcc6c {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:25:10 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:25:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:10 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c 1073741824 Jul 03 17:25:10 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:11 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.352s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:11 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:25:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Deleted volume successfully. Jul 03 17:25:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cde874-9877-49a8-afad-65358c4b0a59 tempest-ServerRescueNegativeTestJSON-1613532613 None] Lock "cinder-8911f84f-cfeb-42eb-b368-9b95c45e78a5-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:25:11 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c 1073741824" returned: 0 in 1.609s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:11 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c Jul 03 17:25:11 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:12 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c" returned: 0 in 1.169s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] <== create_volume: return (2846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:25:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.850s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c16a45-2b55-4b21-93f7-1a706b815e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fe6f19-54fd-4b03-935c-075dbddf2d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Volume volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c (88f48671-ef14-4f4d-8236-6e04d28bcc6c): created successfully Jul 03 17:25:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fe6f19-54fd-4b03-935c-075dbddf2d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Flow 'volume_create_manager' (22ccf744-bb3c-4fb0-aad8-fea2481005e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:25:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3484d558-94b2-4dbb-816d-47c63f3879a7 tempest-TaggedAttachmentsTest-765815345 None] Created volume successfully. Jul 03 17:25:23 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=16,cinder:SELECT=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:25:23 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:43 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:25:43 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Flow 'volume_create_manager' (da1b32d7-9a4c-453f-82d1-2f3efee4b2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85511d46-8c89-4c90-b4ac-6d65c5063d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85511d46-8c89-4c90-b4ac-6d65c5063d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-922196009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ace06bd66e4c2fb407b83a55ad4491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:25:45Z,use_quota=True,user_id='ed3436e50b3d4dcdb5d1c301d00f0992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820b75ed-566a-49de-938d-4f92aab635d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820b75ed-566a-49de-938d-4f92aab635d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ea0699-3946-4b2c-b2eb-0c90976c6253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ea0699-3946-4b2c-b2eb-0c90976c6253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816', 'volume_name': 'volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384ada5d-d239-49d4-a879-9335cf20b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384ada5d-d239-49d4-a879-9335cf20b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcebd51-27c5-45ca-a94a-c20fb31154d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:44 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Volume e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816', 'volume_size': 1} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-922196009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ace06bd66e4c2fb407b83a55ad4491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:25:45Z,use_quota=True,user_id='ed3436e50b3d4dcdb5d1c301d00f0992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Creating volume e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:25:44 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:25:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:44 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 1073741824 Jul 03 17:25:44 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:45 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.306s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:25:46 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 1073741824" returned: 0 in 1.587s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:46 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 Jul 03 17:25:46 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:47 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcebd51-27c5-45ca-a94a-c20fb31154d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f72ae4c-5a1c-4976-99ac-500e8c1aa7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:25:47 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Volume volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 (e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816): created successfully Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f72ae4c-5a1c-4976-99ac-500e8c1aa7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:25:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Flow 'volume_create_manager' (da1b32d7-9a4c-453f-82d1-2f3efee4b2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:25:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-2cc65807-81d9-4ad3-b87f-7025f8126c73 req-ab17e122-8dd5-4712-b31b-63585baa2832 tempest-VolumesSnapshotsTestJSON-368655952 None] Created volume successfully. Jul 03 17:25:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:25:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:25:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Creating offline snapshot 1ea40d1d-01ed-4149-8d84-2c21d308cdab of volume e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:25:48 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb61be47-b6e8-489f-a9f6-f6d27e5016c4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:25:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:48 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 Jul 03 17:25:48 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:49 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" returned: 0 in 0.905s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:49 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab 1G Jul 03 17:25:49 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:50 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab 1G" returned: 0 in 0.938s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:50 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab Jul 03 17:25:50 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:51 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab" returned: 0 in 1.047s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:51 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab is being set with open permissions: ugo+rw Jul 03 17:25:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:51 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab Jul 03 17:25:51 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:52 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab" returned: 0 in 1.448s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:52 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info Jul 03 17:25:52 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:54 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info" returned: 0 in 2.024s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:54 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info is being set with open permissions: ugo+rw Jul 03 17:25:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:54 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info Jul 03 17:25:54 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:55 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.info" returned: 0 in 1.376s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.924s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:25:56 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-92e279a2-7c12-4497-8870-98d3a7832985 req-77d031cd-d70e-484f-941c-7928c8df27bf tempest-VolumesSnapshotsTestJSON-368655952 None] Create snapshot completed successfully Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "cinder-1ea40d1d-01ed-4149-8d84-2c21d308cdab-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-1ea40d1d-01ed-4149-8d84-2c21d308cdab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "cinder-quobyte-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-quobyte-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "cinder-quobyte-1ea40d1d-01ed-4149-8d84-2c21d308cdab" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-quobyte-1ea40d1d-01ed-4149-8d84-2c21d308cdab" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Deleting offline snapshot 1ea40d1d-01ed-4149-8d84-2c21d308cdab of volume e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] snapshot_file for this snap is: volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[29780aad-ce52-4159-9d4f-6cd04852168e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:25:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:57 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab Jul 03 17:25:57 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:25:59 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Jul 03 17:25:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab" returned: 0 in 1.854s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:25:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:25:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5d817-fa16-4ac6-ba74-5a87d8e540f3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:25:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:25:59 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 Jul 03 17:25:59 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:01 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" returned: 0 in 1.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:01 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab Jul 03 17:26:01 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:02 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab" returned: 0 in 1.059s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:02 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab Jul 03 17:26:02 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:02 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816.1ea40d1d-01ed-4149-8d84-2c21d308cdab" returned: 0 in 0.680s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-quobyte-1ea40d1d-01ed-4149-8d84-2c21d308cdab" released by "_delete_snapshot" :: held 5.508s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-quobyte-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" released by "delete_snapshot" :: held 5.573s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:03 devstack cinder-volume[86621]: WARNING cinder.quota [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:26:03 devstack cinder-volume[86621]: DEBUG cinder.quota [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Created reservations ['045dddbc-0561-4e63-b3cd-826603f9e868', '97c5d7b4-0d35-4540-8411-55db9d8c15e1', '70889382-9119-4f31-991a-136ecabce394', 'f9ac65a1-1a33-43bf-8139-ee77ac3ff9e3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:26:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Delete snapshot completed successfully. Jul 03 17:26:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cb819f63-16bc-42d2-b1b4-e3adbd883979 req-619fc32b-c8c6-4db7-8f69-fba725697c1c tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-1ea40d1d-01ed-4149-8d84-2c21d308cdab-delete_snapshot" released by "delete_snapshot" :: held 5.826s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "cinder-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:26:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:26:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "cinder-quobyte-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:26:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-quobyte-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:26:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb80fea7-081a-457c-8b05-bc4c12ff59ce]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:04 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 Jul 03 17:26:04 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:05 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" returned: 0 in 0.909s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:05 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816 Jul 03 17:26:05 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:06 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" returned: 0 in 0.894s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-quobyte-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816" released by "delete_volume" :: held 1.859s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG cinder.quota [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Created reservations ['5d1a7bca-bed1-4496-94d0-b041ca308077', 'be5c11d8-8d2f-476f-92af-9e90ad195c8c', '5751c23f-182d-499c-b5f7-ca034ab00b63', '1903ab76-4500-4ff8-baf1-9d0cf359f013'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:06 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:26:06 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:07 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:07 devstack cinder-volume[86621]: DEBUG cinder.manager [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:26:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Deleted volume successfully. Jul 03 17:26:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-c6891a9a-083d-4f4e-a1d9-73417d3329a1 req-a37db2cb-8349-4e30-9d63-2d96f9bc63cd tempest-VolumesSnapshotsTestJSON-368655952 None] Lock "cinder-e1d385aa-c2a3-4b9a-85c7-1cfba3aaa816-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a83d5d7f-2c8b-46ab-84d2-3326b6a27d15 tempest-GroupsV314Test-259702324 None] Group tempest-GroupsV314Test-Group-2141700081: creating Jul 03 17:26:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a83d5d7f-2c8b-46ab-84d2-3326b6a27d15 tempest-GroupsV314Test-259702324 None] Group tempest-GroupsV314Test-Group-2141700081: created successfully Jul 03 17:26:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a83d5d7f-2c8b-46ab-84d2-3326b6a27d15 tempest-GroupsV314Test-259702324 None] Create group completed successfully. Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Flow 'volume_create_manager' (3a04cd23-5ca6-4467-8958-a76f94356431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345c0365-d349-410d-887f-d035f5f1b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345c0365-d349-410d-887f-d035f5f1b05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1888659499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaa80707-157e-4ce1-8e93-58f6663955d8,host='devstack@QuobyteHD#QuobyteHD',id=cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b5b6b127234da6bf5484454ddbee56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:26:13Z,use_quota=True,user_id='57f08e10958a467c8fa89943d7356d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ab4b56-2fa4-436f-baeb-abdaf95a81cf),volume_type_id=b2ab4b56-2fa4-436f-baeb-abdaf95a81cf)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f884f59-208d-4583-8f85-2a757491f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f884f59-208d-4583-8f85-2a757491f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba52eed-bd59-46e7-9210-9e9509f6d457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba52eed-bd59-46e7-9210-9e9509f6d457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8', 'volume_name': 'volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e4abf1-7ba9-4782-9f70-d974f02fa469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e4abf1-7ba9-4782-9f70-d974f02fa469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d96c54f-71bc-469c-8c37-1f7cf103c582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Volume cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8', 'volume_size': 1} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eaa80707-157e-4ce1-8e93-58f6663955d8,created_at=2026-07-03T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1888659499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaa80707-157e-4ce1-8e93-58f6663955d8,host='devstack@QuobyteHD#QuobyteHD',id=cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b5b6b127234da6bf5484454ddbee56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:26:13Z,use_quota=True,user_id='57f08e10958a467c8fa89943d7356d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2ab4b56-2fa4-436f-baeb-abdaf95a81cf),volume_type_id=b2ab4b56-2fa4-436f-baeb-abdaf95a81cf)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Creating volume cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:26:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:26:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:13 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 1073741824 Jul 03 17:26:13 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:14 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 1073741824" returned: 0 in 0.946s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:14 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:14 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:15 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d96c54f-71bc-469c-8c37-1f7cf103c582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f79572-992a-4717-8301-6cbfffc039cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Volume volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 (cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8): created successfully Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f79572-992a-4717-8301-6cbfffc039cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Flow 'volume_create_manager' (3a04cd23-5ca6-4467-8958-a76f94356431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:26:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fa68ad85-c317-48b0-9dcf-0324dbcafa59 tempest-GroupsV314Test-259702324 None] Created volume successfully. Jul 03 17:26:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:16 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Cloning volume cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 to volume 45d8877d-264e-4de6-bb45-fae6bd22a104 Jul 03 17:26:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Creating offline snapshot b3b9b576-5d44-4ab2-a00b-04213430eb10 of volume cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:26:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90b98f8-2164-4159-9042-fe27405a0060]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:17 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:17 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:17 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 0.783s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:17 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 1G Jul 03 17:26:17 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:18 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 1G" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:18 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 Jul 03 17:26:18 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:19 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:19 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:19 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 Jul 03 17:26:19 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Flow 'volume_create_manager' (22fd3e9e-5635-4f0a-8e16-5477d1567319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a1b867-d791-43e5-a0e7-fe43a90ce50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a1b867-d791-43e5-a0e7-fe43a90ce50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1586594690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfc3c20-a51a-47b6-afa7-628c0bb511d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb64a7e3a4a4e9da05689a18e0f15f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:26:20Z,use_quota=True,user_id='32f61691f47749b9837106f775880aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c96cb32-8a9a-424b-a5a1-7607c7840b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c96cb32-8a9a-424b-a5a1-7607c7840b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba68aa8-ddfd-444c-b2d1-58ac4d41e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba68aa8-ddfd-444c-b2d1-58ac4d41e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bfc3c20-a51a-47b6-afa7-628c0bb511d4', 'volume_name': 'volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c72f73c-c533-4a78-aa52-ecba1cc25366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c72f73c-c533-4a78-aa52-ecba1cc25366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab85146-815c-4af0-bd99-055b05c4dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:19 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Volume 2bfc3c20-a51a-47b6-afa7-628c0bb511d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4', 'volume_size': 1} Jul 03 17:26:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:20 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:20 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info Jul 03 17:26:20 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:20 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info" returned: 0 in 0.773s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:20 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:26:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:20 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info Jul 03 17:26:20 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:21 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.info" returned: 0 in 0.733s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Acquiring lock "cinder-quobyte-45d8877d-264e-4de6-bb45-fae6bd22a104" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-45d8877d-264e-4de6-bb45-fae6bd22a104" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] snapshot: b3b9b576-5d44-4ab2-a00b-04213430eb10, volume: 45d8877d-264e-4de6-bb45-fae6bd22a104, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa8704-c109-4334-903e-84807028df05]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:21 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 Jul 03 17:26:21 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Flow 'volume_create_manager' (aa791ee6-4cb0-43d2-9730-fa65a4d689ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b46335-a1c1-40c7-8588-4212e5ebe55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b46335-a1c1-40c7-8588-4212e5ebe55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-820996210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf1b923-36cf-42f4-bee6-14db82b8f821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b6730c1f2748a2b9991003fe87b1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:26:22Z,use_quota=True,user_id='df015c05cb0544aa831e953df84e47f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f292fd-2ee8-40c8-bfac-54f58d1b6f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f292fd-2ee8-40c8-bfac-54f58d1b6f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7ed255-72e4-4ebd-9ff0-fe4954274db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7ed255-72e4-4ebd-9ff0-fe4954274db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf1b923-36cf-42f4-bee6-14db82b8f821', 'volume_name': 'volume-3bf1b923-36cf-42f4-bee6-14db82b8f821', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda62aaf-ee16-44b6-9c8d-ccaa2f3cb798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda62aaf-ee16-44b6-9c8d-ccaa2f3cb798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd50a06-0bb3-41d2-b5a9-82e7316543ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Volume 3bf1b923-36cf-42f4-bee6-14db82b8f821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf1b923-36cf-42f4-bee6-14db82b8f821', 'volume_size': 1} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:22 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10" returned: 0 in 0.882s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fcd5ee-b219-4aa5-bc29-26e826d3a753]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:22 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:22 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:23 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:23 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:26:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:23 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 Jul 03 17:26:23 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:28 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104" returned: 0 in 5.318s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:28 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f00df5-d3ac-447a-9f07-395b72d529dc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:28 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:28 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:29 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 1.040s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:29 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:26:29 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Converted 1024.00 MB image at 192.51 MB/s Jul 03 17:26:29 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:26:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:29 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 Jul 03 17:26:29 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:30 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104" returned: 0 in 0.689s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-45d8877d-264e-4de6-bb45-fae6bd22a104" released by "_copy_volume_from_snapshot" :: held 8.844s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Acquiring lock "cinder-quobyte-b3b9b576-5d44-4ab2-a00b-04213430eb10" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-b3b9b576-5d44-4ab2-a00b-04213430eb10" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Deleting offline snapshot b3b9b576-5d44-4ab2-a00b-04213430eb10 of volume cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] snapshot_file for this snap is: volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[696e45ae-3284-40a0-b20b-982d3ab57f9e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:30 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 Jul 03 17:26:30 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:31 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10" returned: 0 in 0.728s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:26:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b41b4a-68d4-4d40-b9a1-04e523142f8e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:31 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:31 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:32 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 0.779s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:32 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 Jul 03 17:26:32 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:32 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=30,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:26:32 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10" returned: 0 in 0.795s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:32 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10 Jul 03 17:26:32 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:33 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8.b3b9b576-5d44-4ab2-a00b-04213430eb10" returned: 0 in 0.661s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-b3b9b576-5d44-4ab2-a00b-04213430eb10" released by "_delete_snapshot" :: held 3.041s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.642s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.731s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1586594690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfc3c20-a51a-47b6-afa7-628c0bb511d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb64a7e3a4a4e9da05689a18e0f15f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:26:20Z,use_quota=True,user_id='32f61691f47749b9837106f775880aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Creating volume 2bfc3c20-a51a-47b6-afa7-628c0bb511d4 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:26:33 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:26:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:33 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 1073741824 Jul 03 17:26:33 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f13faa5c-809f-4885-b531-084a96612a45 tempest-GroupsV314Test-259702324 None] Create group from source-group-eaa80707-157e-4ce1-8e93-58f6663955d8 completed successfully. Jul 03 17:26:34 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 1073741824" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:34 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 Jul 03 17:26:34 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Acquiring lock "cinder-quobyte-45d8877d-264e-4de6-bb45-fae6bd22a104" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-45d8877d-264e-4de6-bb45-fae6bd22a104" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c5040-e459-4328-9697-12e5adb0a0d7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:35 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" returned: 0 in 0.929s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.680s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[884bdd23-d02c-4884-840a-80efc425d317]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab85146-815c-4af0-bd99-055b05c4dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6369474-23f3-49b4-921a-09501875fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:35 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Volume volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 (2bfc3c20-a51a-47b6-afa7-628c0bb511d4): created successfully Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6369474-23f3-49b4-921a-09501875fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Flow 'volume_create_manager' (22fd3e9e-5635-4f0a-8e16-5477d1567319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:26:35 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 Jul 03 17:26:35 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f6337214-0ffe-441d-a109-2b1ecc4598fc tempest-ServerActionsTestOtherA-637660669 None] Created volume successfully. Jul 03 17:26:35 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c Jul 03 17:26:35 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:36 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c" returned: 0 in 0.972s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.150s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-820996210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf1b923-36cf-42f4-bee6-14db82b8f821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b6730c1f2748a2b9991003fe87b1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:26:22Z,use_quota=True,user_id='df015c05cb0544aa831e953df84e47f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Creating volume 3bf1b923-36cf-42f4-bee6-14db82b8f821 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:36 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:26:36 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104" returned: 0 in 1.211s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:36 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 1073741824 Jul 03 17:26:36 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:36 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104 Jul 03 17:26:36 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28cd2a4f-2578-425f-8187-77d5f36f46d8', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:26:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-57b381ea-a5bb-4beb-9861-9019a7ef43c7 req-765eafbc-ac88-47a4-b00b-f67630566c48 tempest-TaggedAttachmentsTest-765815345 None] attachment_update completed successfully. Jul 03 17:26:37 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45d8877d-264e-4de6-bb45-fae6bd22a104" returned: 0 in 0.947s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-45d8877d-264e-4de6-bb45-fae6bd22a104" released by "delete_volume" :: held 2.251s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Created reservations ['79a351a5-b39d-40fb-b6a8-622ab875918b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:26:37 devstack cinder-volume[86621]: WARNING cinder.quota [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-169174396 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-169174396, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:26:37 devstack cinder-volume[86621]: WARNING cinder.quota [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-169174396 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-169174396, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Created reservations ['e33b91c3-8edb-4771-b50e-28b3128c64ee', '100af002-a541-41d6-a9dc-3f2b7221da8f', '44e5fb9e-71ae-413f-b003-6e7781f120e0', 'c45185a6-5180-4246-9a66-5c71793d76bf'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:37 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:26:37 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:37 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 1073741824" returned: 0 in 1.552s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:38 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 Jul 03 17:26:38 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:38 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.873s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:26:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d8b3aab2-6c1f-42fe-abcf-6dfecf32f2ec tempest-GroupsV314Test-259702324 None] Delete group completed successfully. Jul 03 17:26:38 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821" returned: 0 in 0.839s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] <== create_volume: return (2477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd50a06-0bb3-41d2-b5a9-82e7316543ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf1b923-36cf-42f4-bee6-14db82b8f821', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426e9c2f-02cd-40f0-a5f5-956dfed5290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:26:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Volume volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 (3bf1b923-36cf-42f4-bee6-14db82b8f821): created successfully Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426e9c2f-02cd-40f0-a5f5-956dfed5290c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:26:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Flow 'volume_create_manager' (aa791ee6-4cb0-43d2-9730-fa65a4d689ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:26:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2578755c-1a0d-4576-a0f2-eed32fb2216e tempest-AttachVolumeShelveTestJSON-1459766598 None] Created volume successfully. Jul 03 17:26:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Acquiring lock "cinder-quobyte-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:26:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:26:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf4f9d-daf3-4d0b-a288-6e2418a2a418]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:26:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:39 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:39 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:40 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 0.935s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:40 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8 Jul 03 17:26:40 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:41 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Lock "cinder-quobyte-cc46eac7-9ac2-47ed-8ef8-95d1748a2ac8" released by "delete_volume" :: held 1.816s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Created reservations ['739d019f-7291-42d6-a4ef-7a1f1db85206'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Created reservations ['432d8045-a064-4c3c-935c-ca15793486e0', 'fb2ec376-c47c-4a73-b624-7696b3502540', 'e8a4008d-4a76-4165-94bd-eae9211db874', '7cd35c69-c224-4874-9850-547c1af8311f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:41 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:26:41 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:42 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.209s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:42 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:26:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-537839d2-7970-46fd-aeee-6340625bd711 tempest-GroupsV314Test-259702324 None] Delete group completed successfully. Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:26:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:26:43 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:26:43 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:26:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-b0b3b89b-cf60-4f29-9d19-bac5202dcf05 req-cf8f1952-6b00-451d-a03e-55863d9d606e tempest-TaggedAttachmentsTest-765815345 None] Terminate volume connection completed successfully. Jul 03 17:26:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-b0b3b89b-cf60-4f29-9d19-bac5202dcf05 req-cf8f1952-6b00-451d-a03e-55863d9d606e tempest-TaggedAttachmentsTest-765815345 None] Deleting attachment 28cd2a4f-2578-425f-8187-77d5f36f46d8. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:26:44 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Jul 03 17:26:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.167s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:26:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:26:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:26:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 8 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:26:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:26:48 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=55,cinder:INSERT=13,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:26:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-79702864-899d-43c9-84f5-7853fa0d8dae req-13b31a94-c541-4e1c-b58b-f019b7e3a498 tempest-AttachVolumeShelveTestJSON-1459766598 None] No connector for attachment cbd36b12-252f-4435-8531-4b7c80c17e96; skipping storage backend terminate_connection call. {{(pid=86621) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 17:26:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-79702864-899d-43c9-84f5-7853fa0d8dae req-13b31a94-c541-4e1c-b58b-f019b7e3a498 tempest-AttachVolumeShelveTestJSON-1459766598 None] Deleting attachment cbd36b12-252f-4435-8531-4b7c80c17e96. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:27:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a0c01-e162-4e71-95ed-5eeed52597c8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:03 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 Jul 03 17:27:03 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Acquiring lock "cinder-88f48671-ef14-4f4d-8236-6e04d28bcc6c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Lock "cinder-88f48671-ef14-4f4d-8236-6e04d28bcc6c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Acquiring lock "cinder-quobyte-88f48671-ef14-4f4d-8236-6e04d28bcc6c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Lock "cinder-quobyte-88f48671-ef14-4f4d-8236-6e04d28bcc6c" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b61df1-3ef4-44fc-846a-7061b7163ae5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:04 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c Jul 03 17:27:04 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:04 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" returned: 0 in 0.922s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e384de3-ca84-4892-b93d-be3a459037ed', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:27:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-e6999254-099e-4343-b77c-ed718b4d71ae req-2c1ffc9b-d88f-4e36-8a23-a7c1f67e1b2b tempest-ServerActionsTestOtherA-637660669 None] attachment_update completed successfully. Jul 03 17:27:05 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c" returned: 0 in 1.011s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:05 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c Jul 03 17:27:05 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:06 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-88f48671-ef14-4f4d-8236-6e04d28bcc6c" returned: 0 in 0.704s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Lock "cinder-quobyte-88f48671-ef14-4f4d-8236-6e04d28bcc6c" released by "delete_volume" :: held 1.793s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Created reservations ['a040699c-d4cc-449f-bff0-0b284308adfb', 'fcb44115-1448-49a7-995c-18a6f02eac66', 'cd146dcc-5754-4479-acbc-8b7612b19e07', '660f2c76-c253-4614-ac97-51afe23a36dc'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:06 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:06 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:07 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:07 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Deleted volume successfully. Jul 03 17:27:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ddd36d4f-a808-4fb0-a908-f5658370e147 tempest-TaggedAttachmentsTest-765815345 None] Lock "cinder-88f48671-ef14-4f4d-8236-6e04d28bcc6c-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Flow 'volume_create_manager' (d62b1cdd-e6d2-4184-97fd-1ac6cda7ab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27e25d3-70d6-4f09-98e3-9f336ffc5adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27e25d3-70d6-4f09-98e3-9f336ffc5adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-860908092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff971cbf-1c99-452c-98eb-8c7788fb402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1f0948b85c49e68f06de46419335ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:09Z,use_quota=True,user_id='21deedb8bb4d4dacb0194f5fca158614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c665efb4-5696-490a-8643-63ae096f7767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c665efb4-5696-490a-8643-63ae096f7767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0927ac8d-f117-454a-bb42-908c77060c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0927ac8d-f117-454a-bb42-908c77060c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff971cbf-1c99-452c-98eb-8c7788fb402c', 'volume_name': 'volume-ff971cbf-1c99-452c-98eb-8c7788fb402c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2cfaeb-1a54-4449-bd89-53a3d4b501ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2cfaeb-1a54-4449-bd89-53a3d4b501ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d2c4d4-12c5-477d-93a9-2738b8466406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Volume ff971cbf-1c99-452c-98eb-8c7788fb402c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff971cbf-1c99-452c-98eb-8c7788fb402c', 'volume_size': 1} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-860908092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff971cbf-1c99-452c-98eb-8c7788fb402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1f0948b85c49e68f06de46419335ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:09Z,use_quota=True,user_id='21deedb8bb4d4dacb0194f5fca158614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Creating volume ff971cbf-1c99-452c-98eb-8c7788fb402c {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:27:09 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:27:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:09 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c 1073741824 Jul 03 17:27:09 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:10 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c 1073741824" returned: 0 in 1.331s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:10 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c Jul 03 17:27:10 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:11 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c" returned: 0 in 0.998s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d2c4d4-12c5-477d-93a9-2738b8466406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff971cbf-1c99-452c-98eb-8c7788fb402c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb8cf6a-6137-4853-b588-2d6d8cc11da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Volume volume-ff971cbf-1c99-452c-98eb-8c7788fb402c (ff971cbf-1c99-452c-98eb-8c7788fb402c): created successfully Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb8cf6a-6137-4853-b588-2d6d8cc11da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Flow 'volume_create_manager' (d62b1cdd-e6d2-4184-97fd-1ac6cda7ab6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a6dbe0b9-78bb-483d-96ec-69d823c7f181 tempest-VolumesListAdminTestJSON-1023889368 None] Created volume successfully. Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Flow 'volume_create_manager' (9f337aed-7595-4558-a416-b27ad2c8c272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b7cc16-37d5-4ca9-8943-e15dfddfed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b7cc16-37d5-4ca9-8943-e15dfddfed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-196136599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176b6e7d-1bec-4054-b31d-fafe35fd7140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1f0948b85c49e68f06de46419335ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:13Z,use_quota=True,user_id='21deedb8bb4d4dacb0194f5fca158614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c92aa6-fd7f-4f78-9079-ef6777b8c5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c92aa6-fd7f-4f78-9079-ef6777b8c5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0efb8e-5516-4ab6-826a-8aee0de8125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0efb8e-5516-4ab6-826a-8aee0de8125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176b6e7d-1bec-4054-b31d-fafe35fd7140', 'volume_name': 'volume-176b6e7d-1bec-4054-b31d-fafe35fd7140', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115b1bbe-a0c0-4b4f-82f5-10b24f96381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115b1bbe-a0c0-4b4f-82f5-10b24f96381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04395ad5-28bb-447e-8d26-de6752ed8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Volume 176b6e7d-1bec-4054-b31d-fafe35fd7140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176b6e7d-1bec-4054-b31d-fafe35fd7140', 'volume_size': 1} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-196136599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176b6e7d-1bec-4054-b31d-fafe35fd7140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1f0948b85c49e68f06de46419335ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:13Z,use_quota=True,user_id='21deedb8bb4d4dacb0194f5fca158614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Creating volume 176b6e7d-1bec-4054-b31d-fafe35fd7140 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:27:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:27:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:13 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 1073741824 Jul 03 17:27:13 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:14 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-9795ac30-027d-4386-9bab-8b64255be82d req-56205faa-fcec-408a-9247-cb8fbb3c1dcb tempest-ServerActionsTestOtherA-637660669 None] Terminate volume connection completed successfully. Jul 03 17:27:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-9795ac30-027d-4386-9bab-8b64255be82d req-56205faa-fcec-408a-9247-cb8fbb3c1dcb tempest-ServerActionsTestOtherA-637660669 None] Deleting attachment 2e384de3-ca84-4892-b93d-be3a459037ed. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:27:14 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 1073741824" returned: 0 in 1.507s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:14 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 Jul 03 17:27:14 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:15 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140" returned: 0 in 0.910s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04395ad5-28bb-447e-8d26-de6752ed8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176b6e7d-1bec-4054-b31d-fafe35fd7140', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74893779-c8cb-411c-8dc9-c2216f7e7d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Volume volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 (176b6e7d-1bec-4054-b31d-fafe35fd7140): created successfully Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74893779-c8cb-411c-8dc9-c2216f7e7d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Flow 'volume_create_manager' (9f337aed-7595-4558-a416-b27ad2c8c272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-21355234-1be9-4a8c-911e-f157ae4b34e5 tempest-VolumesListAdminTestJSON-1023889368 None] Created volume successfully. Jul 03 17:27:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[036ed92a-63fd-4e33-a282-794f6491b273]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Flow 'volume_create_manager' (24a846c3-1b6f-4e57-bd5a-a82122f72181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58980989-0401-4d23-ae38-46f87c589147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58980989-0401-4d23-ae38-46f87c589147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1079434358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065bf72-69ff-4f16-bfa4-a51295777766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1f0948b85c49e68f06de46419335ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:17Z,use_quota=True,user_id='21deedb8bb4d4dacb0194f5fca158614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac453e44-6aa2-4a40-9e19-fb735b346305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac453e44-6aa2-4a40-9e19-fb735b346305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d067eb-f947-4b82-adc1-23c4d1fa34de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d067eb-f947-4b82-adc1-23c4d1fa34de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e065bf72-69ff-4f16-bfa4-a51295777766', 'volume_name': 'volume-e065bf72-69ff-4f16-bfa4-a51295777766', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c42ed1-e563-4c82-a424-9205e06c99f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c42ed1-e563-4c82-a424-9205e06c99f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbd7b13-ce1d-42f8-974d-d177f9fe4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:17 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Volume e065bf72-69ff-4f16-bfa4-a51295777766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e065bf72-69ff-4f16-bfa4-a51295777766', 'volume_size': 1} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:17 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 Jul 03 17:27:17 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:17 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" returned: 0 in 0.876s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1079434358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065bf72-69ff-4f16-bfa4-a51295777766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca1f0948b85c49e68f06de46419335ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:17Z,use_quota=True,user_id='21deedb8bb4d4dacb0194f5fca158614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Creating volume e065bf72-69ff-4f16-bfa4-a51295777766 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:27:17 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:17 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 1073741824 Jul 03 17:27:17 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8c4ebc7-42f6-4a97-b7f3-539061a80642', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:27:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-9795ac30-027d-4386-9bab-8b64255be82d req-98592e81-8102-4cd8-bd77-66400bb57b66 tempest-ServerActionsTestOtherA-637660669 None] attachment_update completed successfully. Jul 03 17:27:19 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 1073741824" returned: 0 in 1.076s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:19 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 Jul 03 17:27:19 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:20 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766" returned: 0 in 1.222s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbd7b13-ce1d-42f8-974d-d177f9fe4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e065bf72-69ff-4f16-bfa4-a51295777766', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f2d71-103a-4560-90c8-c54b23f76de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:20 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Volume volume-e065bf72-69ff-4f16-bfa4-a51295777766 (e065bf72-69ff-4f16-bfa4-a51295777766): created successfully Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f2d71-103a-4560-90c8-c54b23f76de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Flow 'volume_create_manager' (24a846c3-1b6f-4e57-bd5a-a82122f72181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5fba50c1-7dbb-43c4-94ff-9252ef12a969 tempest-VolumesListAdminTestJSON-1023889368 None] Created volume successfully. Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Flow 'volume_create_manager' (819a5e15-8df2-4731-8a19-bf618e100791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (836bff4e-599f-48dd-a791-fff7b967fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (836bff4e-599f-48dd-a791-fff7b967fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23283bff-d2d4-41ef-9255-9d6633599cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfc5fa7a053423992393b004764db45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:23Z,use_quota=True,user_id='304d4e80daa1468fa5b6d432447335f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f5b86b-1488-4eeb-ad1c-2ed0a2935254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f5b86b-1488-4eeb-ad1c-2ed0a2935254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9ff1c6-a59e-4451-8f9f-4bd6d8eb1a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9ff1c6-a59e-4451-8f9f-4bd6d8eb1a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23283bff-d2d4-41ef-9255-9d6633599cff', 'volume_name': 'volume-23283bff-d2d4-41ef-9255-9d6633599cff', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb5ac62-9c46-4711-bf35-6c2b0f956594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb5ac62-9c46-4711-bf35-6c2b0f956594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51adb7ee-152e-4b7a-9b8b-6ec07b9cec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Volume 23283bff-d2d4-41ef-9255-9d6633599cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23283bff-d2d4-41ef-9255-9d6633599cff', 'volume_size': 1} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23283bff-d2d4-41ef-9255-9d6633599cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfc5fa7a053423992393b004764db45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:23Z,use_quota=True,user_id='304d4e80daa1468fa5b6d432447335f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Creating volume 23283bff-d2d4-41ef-9255-9d6633599cff {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:27:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:27:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:22 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff 1073741824 Jul 03 17:27:22 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:23 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff 1073741824" returned: 0 in 0.905s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:23 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff Jul 03 17:27:23 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:24 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51adb7ee-152e-4b7a-9b8b-6ec07b9cec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23283bff-d2d4-41ef-9255-9d6633599cff', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6af5fef-fc64-4f47-b099-778c406a2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Volume volume-23283bff-d2d4-41ef-9255-9d6633599cff (23283bff-d2d4-41ef-9255-9d6633599cff): created successfully Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6af5fef-fc64-4f47-b099-778c406a2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Flow 'volume_create_manager' (819a5e15-8df2-4731-8a19-bf618e100791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8a75543b-54a2-46b2-bffe-10c4c68c7312 tempest-VolumesListAdminTestJSON-1511572569 None] Created volume successfully. Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Acquiring lock "cinder-23283bff-d2d4-41ef-9255-9d6633599cff-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "cinder-23283bff-d2d4-41ef-9255-9d6633599cff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Acquiring lock "cinder-quobyte-23283bff-d2d4-41ef-9255-9d6633599cff" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "cinder-quobyte-23283bff-d2d4-41ef-9255-9d6633599cff" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c99d10-2be9-4e7b-b0d4-09c3d9c338de]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "cinder-e065bf72-69ff-4f16-bfa4-a51295777766-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-e065bf72-69ff-4f16-bfa4-a51295777766-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "cinder-quobyte-e065bf72-69ff-4f16-bfa4-a51295777766" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-quobyte-e065bf72-69ff-4f16-bfa4-a51295777766" acquired by "delete_volume" :: waited 0.044s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:26 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff Jul 03 17:27:26 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e802957-0801-4553-a90b-8aedbb403dff]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:27 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 Jul 03 17:27:27 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:27 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff" returned: 0 in 1.572s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:27 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff Jul 03 17:27:27 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:28 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766" returned: 0 in 1.743s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:28 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766 Jul 03 17:27:28 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:29 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23283bff-d2d4-41ef-9255-9d6633599cff" returned: 0 in 2.087s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "cinder-quobyte-23283bff-d2d4-41ef-9255-9d6633599cff" released by "delete_volume" :: held 3.772s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Created reservations ['d5000795-dd01-437f-b63b-25bbd924162f', '3bfc467f-0b7e-4641-9f8a-d0c60b4b27bd', 'f5b16943-a651-437d-85b5-1205693c74b4', '6da8f491-fcf6-4e0d-a3c1-8f7673cdac81'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:30 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e065bf72-69ff-4f16-bfa4-a51295777766" returned: 0 in 1.910s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:30 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:30 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-quobyte-e065bf72-69ff-4f16-bfa4-a51295777766" released by "delete_volume" :: held 3.748s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Created reservations ['5e13f71b-ebcf-4380-9c81-4575267e24ae', 'f1262530-1795-4ef0-b491-c82ff2182c79', '24e92cbe-1a97-4562-83bb-499f1b52fdd4', 'c90c264d-5d84-4f18-bf6d-e1bc0cf56d43'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:30 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:30 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "cinder-176b6e7d-1bec-4054-b31d-fafe35fd7140-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-176b6e7d-1bec-4054-b31d-fafe35fd7140-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "cinder-quobyte-176b6e7d-1bec-4054-b31d-fafe35fd7140" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-quobyte-176b6e7d-1bec-4054-b31d-fafe35fd7140" acquired by "delete_volume" :: waited 0.058s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:31 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:31 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.454s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Deleted volume successfully. Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[54307e97-c8f4-4f59-a674-9597fe3453a9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-81148590-80bf-4709-987f-f7dea0ca2b86 tempest-VolumesListAdminTestJSON-1511572569 None] Lock "cinder-23283bff-d2d4-41ef-9255-9d6633599cff-delete_volume" released by "delete_volume" :: held 5.879s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Deleted volume successfully. Jul 03 17:27:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c1004b3e-3837-451f-aebb-14767d001c20 tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-e065bf72-69ff-4f16-bfa4-a51295777766-delete_volume" released by "delete_volume" :: held 5.693s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:32 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 Jul 03 17:27:32 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:33 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140" returned: 0 in 1.370s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:33 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140 Jul 03 17:27:33 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:34 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-176b6e7d-1bec-4054-b31d-fafe35fd7140" returned: 0 in 1.275s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-quobyte-176b6e7d-1bec-4054-b31d-fafe35fd7140" released by "delete_volume" :: held 2.763s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=76,cinder:SELECT=63,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Created reservations ['d3307649-f13a-4a5b-8582-e3978a7dbacd', '338ab55b-9346-4962-b47e-308fe5c20d92', '49a25bb1-c5d7-47b2-adaf-7aabf7639713', 'e81e5a45-4c3a-4212-b4c0-7f5e804904c3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:34 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:34 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "cinder-ff971cbf-1c99-452c-98eb-8c7788fb402c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-ff971cbf-1c99-452c-98eb-8c7788fb402c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "cinder-quobyte-ff971cbf-1c99-452c-98eb-8c7788fb402c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-quobyte-ff971cbf-1c99-452c-98eb-8c7788fb402c" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b50ef7-660b-441b-9835-0d7d741649f0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:35 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c Jul 03 17:27:35 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:35 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.015s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Deleted volume successfully. Jul 03 17:27:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d377afba-e3b4-453e-baae-09fb47ca425b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-176b6e7d-1bec-4054-b31d-fafe35fd7140-delete_volume" released by "delete_volume" :: held 4.237s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:36 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c" returned: 0 in 1.100s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:36 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c Jul 03 17:27:36 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:37 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff971cbf-1c99-452c-98eb-8c7788fb402c" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-quobyte-ff971cbf-1c99-452c-98eb-8c7788fb402c" released by "delete_volume" :: held 1.828s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Created reservations ['1b1962b3-7100-4166-8179-397dcd1c1d0a', '51f33ed8-0434-4abe-b827-985302faffa9', 'adcdbdff-d5c6-4b28-905e-521c03fe0eed', 'cc8dddf8-9836-4b03-ad1d-0fbf772f2387'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:37 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:37 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:38 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.819s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:38 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Deleted volume successfully. Jul 03 17:27:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7ddec057-7a64-4739-9069-7769a36e407b tempest-VolumesListAdminTestJSON-1023889368 None] Lock "cinder-ff971cbf-1c99-452c-98eb-8c7788fb402c-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:43 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:43 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:44 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.129s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:27:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 9 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:27:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:27:45 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Flow 'volume_create_manager' (ab15e732-f819-42dd-b038-c993c1b475ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d104654b-1b56-45a4-b1ec-1005a4f9b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d104654b-1b56-45a4-b1ec-1005a4f9b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1664602020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90423c71-1f9e-4444-9f62-327caf2ce989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08ede1202bb4bc2b4106ea682ac1290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:46Z,use_quota=True,user_id='cfb8116786264b6faa018068c08ec7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9f1b0a-19ba-4330-acc4-6ae009cee518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9f1b0a-19ba-4330-acc4-6ae009cee518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecc9db2-f4e5-490f-bb88-be5850c0e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecc9db2-f4e5-490f-bb88-be5850c0e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90423c71-1f9e-4444-9f62-327caf2ce989', 'volume_name': 'volume-90423c71-1f9e-4444-9f62-327caf2ce989', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da3b04b-3240-4990-a9ea-70cfb154f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da3b04b-3240-4990-a9ea-70cfb154f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fb30f7-fdf1-41f3-9423-216d7f36febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:46 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Volume 90423c71-1f9e-4444-9f62-327caf2ce989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90423c71-1f9e-4444-9f62-327caf2ce989', 'volume_size': 1} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1664602020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90423c71-1f9e-4444-9f62-327caf2ce989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08ede1202bb4bc2b4106ea682ac1290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:27:46Z,use_quota=True,user_id='cfb8116786264b6faa018068c08ec7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Creating volume 90423c71-1f9e-4444-9f62-327caf2ce989 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:27:46 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:27:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:46 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 1073741824 Jul 03 17:27:46 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:47 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 1073741824" returned: 0 in 0.890s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:47 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 Jul 03 17:27:47 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:47 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989" returned: 0 in 0.648s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fb30f7-fdf1-41f3-9423-216d7f36febe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90423c71-1f9e-4444-9f62-327caf2ce989', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130e6409-9abd-462e-9b1d-49d9583ab80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:47 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Volume volume-90423c71-1f9e-4444-9f62-327caf2ce989 (90423c71-1f9e-4444-9f62-327caf2ce989): created successfully Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130e6409-9abd-462e-9b1d-49d9583ab80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Flow 'volume_create_manager' (ab15e732-f819-42dd-b038-c993c1b475ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9d3d31b5-aed3-4ad5-bc1d-a3d2b99cb8b2 tempest-VolumesMetadataTest-1616393298 None] Created volume successfully. Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Acquiring lock "cinder-90423c71-1f9e-4444-9f62-327caf2ce989-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Lock "cinder-90423c71-1f9e-4444-9f62-327caf2ce989-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Acquiring lock "cinder-quobyte-90423c71-1f9e-4444-9f62-327caf2ce989" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Lock "cinder-quobyte-90423c71-1f9e-4444-9f62-327caf2ce989" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1227aa-a5f4-470b-abe5-73f0aad892d4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:49 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 Jul 03 17:27:49 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:49 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989" returned: 0 in 0.741s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:49 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989 Jul 03 17:27:49 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:50 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-90423c71-1f9e-4444-9f62-327caf2ce989" returned: 0 in 0.686s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Lock "cinder-quobyte-90423c71-1f9e-4444-9f62-327caf2ce989" released by "delete_volume" :: held 1.473s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Created reservations ['81b12ff9-7312-4b8e-b5d0-f0428549ee30', '3a228b77-5732-4d1a-b07f-3fa44babcedc', 'ffa22bc5-d29d-4ccf-a6f1-76abdcfe2aef', '067f9984-76bb-4336-a047-d62c44a9fdf4'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:50 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:50 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:51 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:51 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Deleted volume successfully. Jul 03 17:27:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b0af61a-dd82-4f3f-951a-eba046bbfedc tempest-VolumesMetadataTest-1616393298 None] Lock "cinder-90423c71-1f9e-4444-9f62-327caf2ce989-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-2bfad7c8-49ba-4443-8501-fda76a0b5dd8 req-a5ca85e1-af82-4ff3-9f75-d3ee333be743 tempest-ServerActionsTestOtherA-637660669 None] Terminate volume connection completed successfully. Jul 03 17:27:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-2bfad7c8-49ba-4443-8501-fda76a0b5dd8 req-a5ca85e1-af82-4ff3-9f75-d3ee333be743 tempest-ServerActionsTestOtherA-637660669 None] Deleting attachment b8c4ebc7-42f6-4a97-b7f3-539061a80642. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:27:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Acquiring lock "cinder-3bf1b923-36cf-42f4-bee6-14db82b8f821-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "cinder-3bf1b923-36cf-42f4-bee6-14db82b8f821-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Acquiring lock "cinder-quobyte-3bf1b923-36cf-42f4-bee6-14db82b8f821" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:27:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "cinder-quobyte-3bf1b923-36cf-42f4-bee6-14db82b8f821" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:27:54 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc8da60-6f34-4f93-ad05-0112997759c8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:27:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:54 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 Jul 03 17:27:54 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:55 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821" returned: 0 in 1.160s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:55 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821 Jul 03 17:27:55 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:57 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3bf1b923-36cf-42f4-bee6-14db82b8f821" returned: 0 in 1.741s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "cinder-quobyte-3bf1b923-36cf-42f4-bee6-14db82b8f821" released by "delete_volume" :: held 2.998s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Created reservations ['0ccd37c1-9579-46d0-be68-db89200a717e', 'ae9c48ac-5ab3-4633-ac4a-f2fe666d8941', 'b588fb04-60a7-4e6f-b21f-8975899683d7', '095b64d0-bae4-4cb3-b18d-7e9038064ce2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:27:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:27:57 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:27:57 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:27:59 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.490s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:27:59 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Deleted volume successfully. Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=55,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8aa75dfc-53de-4519-b753-db169da371f1 tempest-AttachVolumeShelveTestJSON-1459766598 None] Lock "cinder-3bf1b923-36cf-42f4-bee6-14db82b8f821-delete_volume" released by "delete_volume" :: held 4.852s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Flow 'volume_create_manager' (72c5894a-b405-4744-844c-67035270146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c807ed-8073-40d4-9e1b-b0026f99ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c807ed-8073-40d4-9e1b-b0026f99ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-803263985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e7f861-561b-421e-8993-d537a13a7865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b17d104945422d853bdcd09d3cc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:00Z,use_quota=True,user_id='bcf717d87eb24f9fa30fa086b945c79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87628e49-1f03-4753-8d25-f113f9e46f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:27:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87628e49-1f03-4753-8d25-f113f9e46f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9279c0c2-7329-4890-982a-ad32d3bfc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9279c0c2-7329-4890-982a-ad32d3bfc314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e7f861-561b-421e-8993-d537a13a7865', 'volume_name': 'volume-d2e7f861-561b-421e-8993-d537a13a7865', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55f74ba-582b-4140-aa9a-7c16fdafe7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55f74ba-582b-4140-aa9a-7c16fdafe7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ccfed2-4cf1-4e44-8e59-30adadb36df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:00 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Volume d2e7f861-561b-421e-8993-d537a13a7865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e7f861-561b-421e-8993-d537a13a7865', 'volume_size': 1} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-803263985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e7f861-561b-421e-8993-d537a13a7865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b17d104945422d853bdcd09d3cc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:00Z,use_quota=True,user_id='bcf717d87eb24f9fa30fa086b945c79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Creating volume d2e7f861-561b-421e-8993-d537a13a7865 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:28:00 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:28:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:00 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 1073741824 Jul 03 17:28:00 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:01 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 1073741824" returned: 0 in 1.083s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:01 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 Jul 03 17:28:01 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865" returned: 0 in 0.916s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:02 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ccfed2-4cf1-4e44-8e59-30adadb36df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e7f861-561b-421e-8993-d537a13a7865', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77c79aa-61ef-410e-96d5-b7d39292d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:02 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Volume volume-d2e7f861-561b-421e-8993-d537a13a7865 (d2e7f861-561b-421e-8993-d537a13a7865): created successfully Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77c79aa-61ef-410e-96d5-b7d39292d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Flow 'volume_create_manager' (72c5894a-b405-4744-844c-67035270146d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:02 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-29ca0402-f37e-43cf-96ab-6e964b07056a tempest-VolumesTransfersV355Test-1343802745 None] Created volume successfully. Jul 03 17:28:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-67955bd4-646a-4397-a13e-127e030c1385 tempest-VolumesTransfersV355Test-1003822539 None] Transfer volume completed successfully. Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Acquiring lock "cinder-d2e7f861-561b-421e-8993-d537a13a7865-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-d2e7f861-561b-421e-8993-d537a13a7865-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Acquiring lock "cinder-quobyte-d2e7f861-561b-421e-8993-d537a13a7865" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-quobyte-d2e7f861-561b-421e-8993-d537a13a7865" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144a2f9-0794-41c0-8e1e-16e9b1f4b484]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:06 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 Jul 03 17:28:06 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "cinder-2bfc3c20-a51a-47b6-afa7-628c0bb511d4-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Lock "cinder-2bfc3c20-a51a-47b6-afa7-628c0bb511d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "cinder-quobyte-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Lock "cinder-quobyte-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6649a8d-60b8-4a97-b86d-422476443f86]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:28:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:06 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 Jul 03 17:28:06 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:07 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865" returned: 0 in 1.082s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:07 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865 Jul 03 17:28:07 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:07 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" returned: 0 in 0.925s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:07 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4 Jul 03 17:28:07 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:07 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2e7f861-561b-421e-8993-d537a13a7865" returned: 0 in 0.700s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-quobyte-d2e7f861-561b-421e-8993-d537a13a7865" released by "delete_volume" :: held 1.847s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Created reservations ['07fc65cb-499b-4c44-b555-6ec852a99eec', '316b0a6e-7641-411e-8d46-d833cf50b5da', '8f28ee02-10fe-4b94-a768-04a11d77e88b', '8fe8f867-b79d-431b-9d5f-b5d75569f436'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:08 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:28:08 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:08 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" returned: 0 in 0.795s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Lock "cinder-quobyte-2bfc3c20-a51a-47b6-afa7-628c0bb511d4" released by "delete_volume" :: held 1.792s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Created reservations ['2b8e2e62-50a2-46a2-9515-bc27860848b5', '3b12a0ee-3d00-4249-a9d4-50a65e261e10', '8cea1b26-e536-4600-8cd9-15727df8f88d', '031a1120-79d4-4fc2-a160-ce158dc04f1d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:08 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:28:08 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:09 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.135s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:28:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Deleted volume successfully. Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7cd86d49-86fb-48e2-9d06-4c99de76adf7 tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-d2e7f861-561b-421e-8993-d537a13a7865-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Flow 'volume_create_manager' (6aa79a57-e36f-4189-9805-6475d374da3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412c43b3-737b-47fd-a9ff-27d89b8f5c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412c43b3-737b-47fd-a9ff-27d89b8f5c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-608371248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3d6fe-78b2-4ad7-acab-2f557644c0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b17d104945422d853bdcd09d3cc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:09Z,use_quota=True,user_id='bcf717d87eb24f9fa30fa086b945c79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b390309-a962-453e-bf0d-fa214de5aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b390309-a962-453e-bf0d-fa214de5aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3ceaa2-53f5-4245-a3ed-a70337d1c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3ceaa2-53f5-4245-a3ed-a70337d1c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae3d6fe-78b2-4ad7-acab-2f557644c0ac', 'volume_name': 'volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd81cc05-1dc8-4488-a7e8-802536e96eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd81cc05-1dc8-4488-a7e8-802536e96eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d17f37-e78c-49df-b066-629e9ef8dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Volume eae3d6fe-78b2-4ad7-acab-2f557644c0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac', 'volume_size': 1} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-608371248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3d6fe-78b2-4ad7-acab-2f557644c0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b17d104945422d853bdcd09d3cc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:09Z,use_quota=True,user_id='bcf717d87eb24f9fa30fa086b945c79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Creating volume eae3d6fe-78b2-4ad7-acab-2f557644c0ac {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:28:09 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:09 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.132s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:28:09 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac 1073741824 Jul 03 17:28:09 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Deleted volume successfully. Jul 03 17:28:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbc8280-67e3-4d32-bef5-2ee001e0d587 tempest-ServerActionsTestOtherA-637660669 None] Lock "cinder-2bfc3c20-a51a-47b6-afa7-628c0bb511d4-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:10 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac 1073741824" returned: 0 in 1.090s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:10 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac Jul 03 17:28:10 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:11 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac" returned: 0 in 1.040s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d17f37-e78c-49df-b066-629e9ef8dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c97bc81-380e-4b93-82f9-599ae44db067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Volume volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac (eae3d6fe-78b2-4ad7-acab-2f557644c0ac): created successfully Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c97bc81-380e-4b93-82f9-599ae44db067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Flow 'volume_create_manager' (6aa79a57-e36f-4189-9805-6475d374da3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-672dce5f-69d2-40fa-93ee-1112db3b44ac tempest-VolumesTransfersV355Test-1343802745 None] Created volume successfully. Jul 03 17:28:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Acquiring lock "cinder-eae3d6fe-78b2-4ad7-acab-2f557644c0ac-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-eae3d6fe-78b2-4ad7-acab-2f557644c0ac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Acquiring lock "cinder-quobyte-eae3d6fe-78b2-4ad7-acab-2f557644c0ac" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-quobyte-eae3d6fe-78b2-4ad7-acab-2f557644c0ac" acquired by "delete_volume" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:13 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64937b4-470e-4b74-9424-a42474069df0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:28:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:13 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac Jul 03 17:28:13 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:15 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac" returned: 0 in 1.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:15 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac Jul 03 17:28:15 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:16 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-eae3d6fe-78b2-4ad7-acab-2f557644c0ac" returned: 0 in 1.004s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-quobyte-eae3d6fe-78b2-4ad7-acab-2f557644c0ac" released by "delete_volume" :: held 2.828s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Created reservations ['62ebef99-27ca-4c43-8fbd-5c75f1469976', '0b6deb91-0e45-4a01-83e8-d036ed8d015f', '5763d7d1-e7ec-4a31-a482-595b91583c28', 'ddda930c-1062-49a9-b621-1f9f43c44e10'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:16 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:28:16 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:17 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.425s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:17 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:28:17 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Deleted volume successfully. Jul 03 17:28:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3379af9-1174-4496-b930-5ab29c4856bc tempest-VolumesTransfersV355Test-920031043 None] Lock "cinder-eae3d6fe-78b2-4ad7-acab-2f557644c0ac-delete_volume" released by "delete_volume" :: held 4.696s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:26 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:28:27 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=41,cinder:INSERT=15,cinder:UPDATE=61,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Flow 'volume_create_manager' (e8211830-d6f6-4753-9b5b-9965893ca1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e4ff9d-aec6-43a1-94a1-e0563857d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e4ff9d-aec6-43a1-94a1-e0563857d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1816253842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b120be7-2b90-45ae-9b7a-2b4c4277a440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76251f385ba44ada141a5e72ecc8fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:29Z,use_quota=True,user_id='f82499ab476546e58f8db32b704e341f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517fbd40-6798-4898-addb-6d0fd45b38a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517fbd40-6798-4898-addb-6d0fd45b38a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488980ca-e382-4c19-95ff-92613fe1945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488980ca-e382-4c19-95ff-92613fe1945a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b120be7-2b90-45ae-9b7a-2b4c4277a440', 'volume_name': 'volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d11215f-71da-45e3-8a76-1bd10f7d220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d11215f-71da-45e3-8a76-1bd10f7d220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15761d6c-ae73-4893-84ae-7ec60c441165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Volume 0b120be7-2b90-45ae-9b7a-2b4c4277a440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440', 'volume_size': 1} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1816253842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b120be7-2b90-45ae-9b7a-2b4c4277a440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76251f385ba44ada141a5e72ecc8fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:29Z,use_quota=True,user_id='f82499ab476546e58f8db32b704e341f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Creating volume 0b120be7-2b90-45ae-9b7a-2b4c4277a440 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:28:29 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:28:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:29 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 1073741824 Jul 03 17:28:29 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:30 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 1073741824" returned: 0 in 1.204s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:30 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 Jul 03 17:28:30 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:31 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440" returned: 0 in 0.839s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15761d6c-ae73-4893-84ae-7ec60c441165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f807d62-b98d-425f-b89b-a0c7e5e988a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Volume volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 (0b120be7-2b90-45ae-9b7a-2b4c4277a440): created successfully Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f807d62-b98d-425f-b89b-a0c7e5e988a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Flow 'volume_create_manager' (e8211830-d6f6-4753-9b5b-9965893ca1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-300f6a1e-8bb7-433a-85e5-4919df4e0da8 tempest-ServersNegativeTestJSON-1673539245 None] Created volume successfully. Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Flow 'volume_create_manager' (528a5b2e-9471-45ad-a795-82521cb48e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20218490-ec78-4829-97a5-aa820b446ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20218490-ec78-4829-97a5-aa820b446ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1855200586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8d653538e140b59ae075981546dee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:36Z,use_quota=True,user_id='b7c62e7d698b42f1903059bf65c18729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7e581c-0ec5-46c8-a6ba-3a1c8fc1f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7e581c-0ec5-46c8-a6ba-3a1c8fc1f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bb1d26-b6c6-456a-9856-8e67d370e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bb1d26-b6c6-456a-9856-8e67d370e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef', 'volume_name': 'volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23aa2857-3fb6-4eb6-9b64-d72c8ebc2038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23aa2857-3fb6-4eb6-9b64-d72c8ebc2038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30be469-4b22-436a-9848-591be7adc094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Volume da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef', 'volume_size': 1} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1855200586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8d653538e140b59ae075981546dee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:36Z,use_quota=True,user_id='b7c62e7d698b42f1903059bf65c18729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Creating volume da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:28:36 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:28:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:36 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef 1073741824 Jul 03 17:28:36 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:37 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef 1073741824" returned: 0 in 1.343s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:37 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:28:37 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Flow 'volume_create_manager' (728fd847-756d-4219-afa8-11f9572921d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf4e334-b8e9-4432-a24e-7a4224569e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf4e334-b8e9-4432-a24e-7a4224569e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1927019554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32cc6b6-4b37-455b-994c-46bd49b7e99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76251f385ba44ada141a5e72ecc8fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:38Z,use_quota=True,user_id='f82499ab476546e58f8db32b704e341f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac9538e-82c6-4a74-a531-6b2d0aedb36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac9538e-82c6-4a74-a531-6b2d0aedb36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1cc4bc-2031-4d43-a9d3-d472183ace66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1cc4bc-2031-4d43-a9d3-d472183ace66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32cc6b6-4b37-455b-994c-46bd49b7e99a', 'volume_name': 'volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a19dff-7785-4803-b3aa-25e62fb79e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a19dff-7785-4803-b3aa-25e62fb79e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2422c5d5-8650-4d3c-b7fb-8343b77d3eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Volume c32cc6b6-4b37-455b-994c-46bd49b7e99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a', 'volume_size': 1} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:38 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 1.080s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] <== create_volume: return (2514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1927019554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32cc6b6-4b37-455b-994c-46bd49b7e99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76251f385ba44ada141a5e72ecc8fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:28:38Z,use_quota=True,user_id='f82499ab476546e58f8db32b704e341f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Creating volume c32cc6b6-4b37-455b-994c-46bd49b7e99a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:28:39 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30be469-4b22-436a-9848-591be7adc094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:39 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a 1073741824 Jul 03 17:28:39 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef43bd4-7302-4458-8c96-f82cfa5192b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:39 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Volume volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef (da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef): created successfully Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef43bd4-7302-4458-8c96-f82cfa5192b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Flow 'volume_create_manager' (528a5b2e-9471-45ad-a795-82521cb48e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2229a956-2d80-462d-aa74-bbf86a5c1d06 tempest-VolumesActionsTest-1583959074 None] Created volume successfully. Jul 03 17:28:39 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a 1073741824" returned: 0 in 0.960s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:40 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a Jul 03 17:28:40 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:40 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a" returned: 0 in 0.757s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2422c5d5-8650-4d3c-b7fb-8343b77d3eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b42e02-c272-489b-b1e6-7026e3677e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:28:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Volume volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a (c32cc6b6-4b37-455b-994c-46bd49b7e99a): created successfully Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b42e02-c272-489b-b1e6-7026e3677e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:28:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Flow 'volume_create_manager' (728fd847-756d-4219-afa8-11f9572921d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:28:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-23b53c6c-7644-428d-9c3a-998b12d2269f tempest-ServersNegativeTestJSON-1673539245 None] Created volume successfully. Jul 03 17:28:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "cinder-c32cc6b6-4b37-455b-994c-46bd49b7e99a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-c32cc6b6-4b37-455b-994c-46bd49b7e99a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "cinder-quobyte-c32cc6b6-4b37-455b-994c-46bd49b7e99a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-quobyte-c32cc6b6-4b37-455b-994c-46bd49b7e99a" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3025242-1990-4688-9abd-acfd99a7c577]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:28:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:42 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a Jul 03 17:28:42 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:43 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a" returned: 0 in 0.964s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:43 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a Jul 03 17:28:43 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:43 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:28:43 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:44 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c32cc6b6-4b37-455b-994c-46bd49b7e99a" returned: 0 in 0.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-quobyte-c32cc6b6-4b37-455b-994c-46bd49b7e99a" released by "delete_volume" :: held 1.849s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Created reservations ['7d6a0390-a5df-492f-95bd-2528c5d258bf', 'cd764b3d-07eb-4739-9c31-2483d9b2e70e', '0cbd27de-f431-4f8d-af84-27ebcae00593', '46edcaa7-17d5-4a7f-84c0-c69ae6e1702a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:28:44 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.927s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 9 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:44 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:28:44 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "cinder-0b120be7-2b90-45ae-9b7a-2b4c4277a440-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-0b120be7-2b90-45ae-9b7a-2b4c4277a440-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "cinder-quobyte-0b120be7-2b90-45ae-9b7a-2b4c4277a440" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-quobyte-0b120be7-2b90-45ae-9b7a-2b4c4277a440" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46a4596-dd4a-43d0-93f9-23472d71b896]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:28:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:45 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 Jul 03 17:28:45 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:45 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.919s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:28:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Deleted volume successfully. Jul 03 17:28:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f74b5f13-2e5c-449c-b35d-be314e992983 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-c32cc6b6-4b37-455b-994c-46bd49b7e99a-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:45 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440" returned: 0 in 0.959s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:46 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440 Jul 03 17:28:46 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:46 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0b120be7-2b90-45ae-9b7a-2b4c4277a440" returned: 0 in 0.885s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-quobyte-0b120be7-2b90-45ae-9b7a-2b4c4277a440" released by "delete_volume" :: held 1.910s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Created reservations ['ec8688ef-3291-4d8d-81ed-2198a7aed633', '1c4579b2-f0df-46d8-9453-9fa5e830d84d', 'be2bd82e-67d2-47a2-b544-dd70064293e7', 'd7335fdc-5bc0-48a4-8630-bb7e665a35a6'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:28:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:28:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:28:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:28:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:28:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:28:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:28:47 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:28:47 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:28:48 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Jul 03 17:28:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.244s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:28:48 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:28:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Deleted volume successfully. Jul 03 17:28:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1752e6ab-de16-4cd0-b1eb-64d320853509 tempest-ServersNegativeTestJSON-1673539245 None] Lock "cinder-0b120be7-2b90-45ae-9b7a-2b4c4277a440-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:28:58 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:28:58 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=26,cinder:SELECT=14,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:29:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3fa2548f-5c15-4ff0-b1fa-e6c8878c7f46 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" by "attach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3fa2548f-5c15-4ff0-b1fa-e6c8878c7f46 tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" acquired by "attach_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3fa2548f-5c15-4ff0-b1fa-e6c8878c7f46 tempest-VolumesActionsTest-1583959074 None] Attaching volume da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef to instance f6d9ae4d-5a38-49ba-b3bc-aed57cdc7493 at mountpoint /dev/vdb on host None. Jul 03 17:29:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3fa2548f-5c15-4ff0-b1fa-e6c8878c7f46 tempest-VolumesActionsTest-1583959074 None] Attach volume completed successfully. Jul 03 17:29:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3fa2548f-5c15-4ff0-b1fa-e6c8878c7f46 tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" released by "attach_volume" :: held 0.102s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2d4d730-bc82-4a35-a3a7-1061036d7e1e tempest-VolumesActionsTest-1583959074 None] Acquiring lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-detach_volume" by "detach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2d4d730-bc82-4a35-a3a7-1061036d7e1e tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b2d4d730-bc82-4a35-a3a7-1061036d7e1e tempest-VolumesActionsTest-1583959074 None] Detaching volume da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef from instance f6d9ae4d-5a38-49ba-b3bc-aed57cdc7493. Jul 03 17:29:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b2d4d730-bc82-4a35-a3a7-1061036d7e1e tempest-VolumesActionsTest-1583959074 None] Detach volume completed successfully. Jul 03 17:29:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2d4d730-bc82-4a35-a3a7-1061036d7e1e tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-710ef93c-3ea1-42b2-b10d-962f942eb7df tempest-GroupSnapshotsTest-928428047 None] Group tempest-GroupSnapshotsTest-Group-403982306: creating Jul 03 17:29:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-710ef93c-3ea1-42b2-b10d-962f942eb7df tempest-GroupSnapshotsTest-928428047 None] Group tempest-GroupSnapshotsTest-Group-403982306: created successfully Jul 03 17:29:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-710ef93c-3ea1-42b2-b10d-962f942eb7df tempest-GroupSnapshotsTest-928428047 None] Create group completed successfully. Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (04d11fbf-c4f6-488b-bd50-b86efb990357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7683d0e4-a886-450b-86a0-b9e6a709d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7683d0e4-a886-450b-86a0-b9e6a709d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686021791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceb02432-3150-4000-bd3d-b45d1c844da4,host='devstack@QuobyteHD#QuobyteHD',id=1df720f3-9d3f-46b9-b145-529d91ccb6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:07Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0da3c36d-a716-4fb1-b190-795bb2eaf2d7),volume_type_id=0da3c36d-a716-4fb1-b190-795bb2eaf2d7)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d07186-bd4a-431b-9037-cbc3ad4d86f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d07186-bd4a-431b-9037-cbc3ad4d86f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd78eb8-91d0-44f0-b4b0-c64083f2f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd78eb8-91d0-44f0-b4b0-c64083f2f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df720f3-9d3f-46b9-b145-529d91ccb6fd', 'volume_name': 'volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f25c637-161b-48c7-aa49-48f82e39a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f25c637-161b-48c7-aa49-48f82e39a3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9e08e1-a97d-4977-bac3-d5c2a3864725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Volume 1df720f3-9d3f-46b9-b145-529d91ccb6fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd', 'volume_size': 1} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ceb02432-3150-4000-bd3d-b45d1c844da4,created_at=2026-07-03T15:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686021791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceb02432-3150-4000-bd3d-b45d1c844da4,host='devstack@QuobyteHD#QuobyteHD',id=1df720f3-9d3f-46b9-b145-529d91ccb6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:07Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0da3c36d-a716-4fb1-b190-795bb2eaf2d7),volume_type_id=0da3c36d-a716-4fb1-b190-795bb2eaf2d7)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Creating volume 1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:29:07 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:29:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:07 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd 1073741824 Jul 03 17:29:07 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:08 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd 1073741824" returned: 0 in 0.899s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:08 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:08 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:09 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 1.192s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9e08e1-a97d-4977-bac3-d5c2a3864725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa397bf4-553f-4309-9380-1a94c5681c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Volume volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd (1df720f3-9d3f-46b9-b145-529d91ccb6fd): created successfully Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa397bf4-553f-4309-9380-1a94c5681c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (04d11fbf-c4f6-488b-bd50-b86efb990357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-23cea6a7-cc06-4479-b8a0-a8060206d1c2 tempest-GroupSnapshotsTest-928428047 None] Created volume successfully. Jul 03 17:29:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] GroupSnapshot 15bf7d48-3ecd-40e2-8551-d3734bb81b7a: creating. Jul 03 17:29:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Group snapshot 15bf7d48-3ecd-40e2-8551-d3734bb81b7a: creating. {{(pid=86621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 17:29:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Creating offline snapshot 650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 of volume 1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:29:10 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c644c-d0a2-4469-95ab-a1046be204cc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:10 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:10 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:11 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 0.866s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:11 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 1G Jul 03 17:29:11 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:12 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 1G" returned: 0 in 1.012s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:12 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 Jul 03 17:29:12 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:13 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" returned: 0 in 0.858s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:13 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:29:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:13 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 Jul 03 17:29:13 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:14 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" returned: 0 in 0.865s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:14 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info Jul 03 17:29:14 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Flow 'volume_create_manager' (0ce42d8f-7e37-41dc-b450-536535c6ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814ee828-700a-44a7-974c-5d9617ebb398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814ee828-700a-44a7-974c-5d9617ebb398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-516863311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12702dab-cf08-46d3-a8f2-7d989a82442a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438abfdbed64fee9c8f053f14d02747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:15Z,use_quota=True,user_id='195c65867a6b47ef924a3ad4e190ee54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d920d7-1d73-42d7-be45-2e6ba0497297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d920d7-1d73-42d7-be45-2e6ba0497297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c868b86b-4a2c-4f4d-952a-ac433af84ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c868b86b-4a2c-4f4d-952a-ac433af84ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12702dab-cf08-46d3-a8f2-7d989a82442a', 'volume_name': 'volume-12702dab-cf08-46d3-a8f2-7d989a82442a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392f6a60-ebf6-4942-b3f8-bf7a5c244750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392f6a60-ebf6-4942-b3f8-bf7a5c244750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bfcf6b-eff5-4a3d-a64d-68cc22aa8e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Volume 12702dab-cf08-46d3-a8f2-7d989a82442a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12702dab-cf08-46d3-a8f2-7d989a82442a', 'volume_size': 1} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:15 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info" returned: 0 in 0.893s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:15 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:15 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info Jul 03 17:29:15 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:15 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.info" returned: 0 in 0.660s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.265s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-516863311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12702dab-cf08-46d3-a8f2-7d989a82442a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438abfdbed64fee9c8f053f14d02747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:15Z,use_quota=True,user_id='195c65867a6b47ef924a3ad4e190ee54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Creating volume 12702dab-cf08-46d3-a8f2-7d989a82442a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:29:15 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:29:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:15 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a 1073741824 Jul 03 17:29:15 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-748218bc-2533-469f-95a1-728287858e95 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 15bf7d48-3ecd-40e2-8551-d3734bb81b7a: created successfully Jul 03 17:29:16 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a 1073741824" returned: 0 in 0.848s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:16 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a Jul 03 17:29:16 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:17 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a" returned: 0 in 0.697s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bfcf6b-eff5-4a3d-a64d-68cc22aa8e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12702dab-cf08-46d3-a8f2-7d989a82442a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d5c8b1-5fa3-454f-9e23-c4ac3dd0f759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:17 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Volume volume-12702dab-cf08-46d3-a8f2-7d989a82442a (12702dab-cf08-46d3-a8f2-7d989a82442a): created successfully Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d5c8b1-5fa3-454f-9e23-c4ac3dd0f759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Flow 'volume_create_manager' (0ce42d8f-7e37-41dc-b450-536535c6ce24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:17 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-077df411-0ec4-4148-a46b-dce873df4df8 tempest-AttachVolumeNegativeTest-20524444 None] Created volume successfully. Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Creating volume c87843b6-b1f3-49fd-875e-0e6761e4b3bb from snapshot 650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] snapshot: 650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403, volume: c87843b6-b1f3-49fd-875e-0e6761e4b3bb, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8e1dd-9e43-4c72-acd8-9d92bde0f7d7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:18 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 Jul 03 17:29:18 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:19 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" returned: 0 in 1.021s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:29:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:29:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:29:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e3f340-b8c0-4fa6-91fd-4f632f875729]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:19 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:19 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:20 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 1.108s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:20 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:29:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:20 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb Jul 03 17:29:20 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:26 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" returned: 0 in 5.839s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f061afcb-9129-480e-9e94-88c3d30a1d07]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:26 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:26 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:27 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 1.390s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:27 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:29:27 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Converted 1024.00 MB image at 175.32 MB/s Jul 03 17:29:27 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:29:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:27 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb Jul 03 17:29:27 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:INSERT=2,cinder:SELECT=19,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:29:28 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" released by "_copy_volume_from_snapshot" :: held 10.227s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" released by "_create_volume_from_snapshot" :: held 10.266s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.294s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.137s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f85007-1a7c-45cf-8dd8-ddb4fc72e4d9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d0c0b5ed-95b9-41bf-9e7e-c407553ea079 tempest-GroupSnapshotsTest-928428047 None] Create group from source-snapshot-15bf7d48-3ecd-40e2-8551-d3734bb81b7a completed successfully. Jul 03 17:29:28 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a Jul 03 17:29:28 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:29 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a" returned: 0 in 1.141s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.180s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3542e947-3f85-4c84-9e7f-c05a25fe7383]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-12702dab-cf08-46d3-a8f2-7d989a82442a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10b8f159-209b-4303-a4e4-6df57645bc3c', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:29:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-ae8fdea6-6f7a-49fb-864c-90138d1c408e req-ba65a594-58fc-4303-b9a5-9b63e87bfd72 tempest-AttachVolumeNegativeTest-20524444 None] attachment_update completed successfully. Jul 03 17:29:30 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb Jul 03 17:29:30 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a6a0da0-3733-409e-ac80-e164d448a2f6 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" by "attach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a6a0da0-3733-409e-ac80-e164d448a2f6 tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" acquired by "attach_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a6a0da0-3733-409e-ac80-e164d448a2f6 tempest-VolumesActionsTest-1583959074 None] Attaching volume da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef to instance fa8ebbc9-45ba-40f0-8814-d5cae99384d1 at mountpoint /dev/vdb on host None. Jul 03 17:29:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a6a0da0-3733-409e-ac80-e164d448a2f6 tempest-VolumesActionsTest-1583959074 None] Attach volume completed successfully. Jul 03 17:29:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a6a0da0-3733-409e-ac80-e164d448a2f6 tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" released by "attach_volume" :: held 0.129s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:30 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" returned: 0 in 1.082s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:30 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb Jul 03 17:29:30 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21745536-8284-4329-8164-e668cdb3c471 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-detach_volume" by "detach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21745536-8284-4329-8164-e668cdb3c471 tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-21745536-8284-4329-8164-e668cdb3c471 tempest-VolumesActionsTest-1583959074 None] Detaching volume da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef from instance fa8ebbc9-45ba-40f0-8814-d5cae99384d1. Jul 03 17:29:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-21745536-8284-4329-8164-e668cdb3c471 tempest-VolumesActionsTest-1583959074 None] Detach volume completed successfully. Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21745536-8284-4329-8164-e668cdb3c471 tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:31 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" returned: 0 in 0.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-c87843b6-b1f3-49fd-875e-0e6761e4b3bb" released by "delete_volume" :: held 1.893s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['1f446a50-3f8b-4a11-8413-8e16d1880072'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:29:31 devstack cinder-volume[86621]: WARNING cinder.quota [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1190210151 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1190210151, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:29:31 devstack cinder-volume[86621]: WARNING cinder.quota [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1190210151 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1190210151, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['dc71dc44-9bbe-464f-beed-232a912675e8', '59a452a0-3147-4990-857a-d499d9c532d2', '2475a22e-f1bf-4082-a3a0-15b7f60c2d38', '1bd6b918-2828-4984-ad67-75cdbc7c6d87'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:31 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:29:31 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:32 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 15bf7d48-3ecd-40e2-8551-d3734bb81b7a: deleting Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 15bf7d48-3ecd-40e2-8551-d3734bb81b7a: deleting {{(pid=86621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-1df720f3-9d3f-46b9-b145-529d91ccb6fd" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-1df720f3-9d3f-46b9-b145-529d91ccb6fd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Deleting offline snapshot 650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 of volume 1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] snapshot_file for this snap is: volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[af02ed03-1156-4d25-953c-362e47780cf3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:32 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 Jul 03 17:29:32 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:32 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.874s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:32 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:29:32 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-bced454f-1073-44f4-81b0-fadf516b9657 tempest-GroupSnapshotsTest-928428047 None] Delete group completed successfully. Jul 03 17:29:33 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" returned: 0 in 1.259s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:29:33 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[267485d4-5b79-43ff-8271-77205974b092]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:34 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:34 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Flow 'volume_create_manager' (c815169b-866c-4465-89ee-eca0283369ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e8e262-f0a1-4c75-819c-e8eadf7d0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e8e262-f0a1-4c75-819c-e8eadf7d0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-933331926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fda25f-85d9-4e75-99b1-9639916497a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e28cfbf841b472596d541b8be052fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:34Z,use_quota=True,user_id='f74a0c7d95534323b44d0f433c231395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f232e5-da02-415e-8bdc-bc377a5e21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f232e5-da02-415e-8bdc-bc377a5e21dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064a6a32-dfeb-46c6-b861-22ea07c02397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064a6a32-dfeb-46c6-b861-22ea07c02397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fda25f-85d9-4e75-99b1-9639916497a2', 'volume_name': 'volume-23fda25f-85d9-4e75-99b1-9639916497a2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2108ce44-4534-4ebd-9e03-378e4759057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2108ce44-4534-4ebd-9e03-378e4759057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7d2cea-fc96-4816-91af-f850f5692d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Volume 23fda25f-85d9-4e75-99b1-9639916497a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fda25f-85d9-4e75-99b1-9639916497a2', 'volume_size': 1} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-933331926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fda25f-85d9-4e75-99b1-9639916497a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e28cfbf841b472596d541b8be052fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:34Z,use_quota=True,user_id='f74a0c7d95534323b44d0f433c231395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Creating volume 23fda25f-85d9-4e75-99b1-9639916497a2 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:29:34 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:29:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:34 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 1073741824 Jul 03 17:29:34 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:35 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 1.218s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:35 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 Jul 03 17:29:35 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:35 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 1073741824" returned: 0 in 1.131s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:35 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 Jul 03 17:29:35 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:36 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" returned: 0 in 0.974s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:36 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403 Jul 03 17:29:36 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:36 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2" returned: 0 in 0.795s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7d2cea-fc96-4816-91af-f850f5692d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fda25f-85d9-4e75-99b1-9639916497a2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5475e4bc-0824-4d1d-a5fc-bc4005a8290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Volume volume-23fda25f-85d9-4e75-99b1-9639916497a2 (23fda25f-85d9-4e75-99b1-9639916497a2): created successfully Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5475e4bc-0824-4d1d-a5fc-bc4005a8290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Flow 'volume_create_manager' (c815169b-866c-4465-89ee-eca0283369ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e6128b3a-fc9a-4dda-8928-368a676d5266 tempest-AttachVolumeTestJSON-2098638241 None] Created volume successfully. Jul 03 17:29:36 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd.650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" returned: 0 in 0.717s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-650e11d0-ce0f-4f4c-8ca7-7b8fcf34b403" released by "_delete_snapshot" :: held 4.347s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-1df720f3-9d3f-46b9-b145-529d91ccb6fd" released by "delete_snapshot" :: held 4.385s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:36 devstack cinder-volume[86621]: WARNING cinder.quota [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1190210151 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1190210151, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:29:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['4621ab2f-e10b-4e9a-b96b-95b0341fc0ad', '49eaef4b-cb85-4191-a323-371fd39071eb', '0b317a5c-2797-45c1-b1e4-e05f1fbc3504', 'b38a644b-29b5-4c77-8fe3-eb9188234445'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:29:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9e8a6a63-8089-4808-bed6-d6f9a0aab3e1 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 15bf7d48-3ecd-40e2-8551-d3734bb81b7a: deleted successfully Jul 03 17:29:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-1df720f3-9d3f-46b9-b145-529d91ccb6fd" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:29:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-1df720f3-9d3f-46b9-b145-529d91ccb6fd" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:29:38 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c079cf8-8250-4748-852c-21a67ad01b1a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:38 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:38 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:39 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 0.757s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:39 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd Jul 03 17:29:39 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:39 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1df720f3-9d3f-46b9-b145-529d91ccb6fd" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-1df720f3-9d3f-46b9-b145-529d91ccb6fd" released by "delete_volume" :: held 1.568s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:29:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['015a40a5-fe0b-4526-baa7-e4c41b792d27'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:29:39 devstack cinder-volume[86621]: WARNING cinder.db.api [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1190210151'] Jul 03 17:29:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['e7b70349-4003-4525-95b2-225bb9b1d228', '9eb7e695-ff6d-4909-83c0-49cd7cf01f4a', '454f433a-5ce5-471b-96fd-48508ea7cbb0', '37da9d80-d778-4366-9b34-ffbacbb8066c'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:40 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:29:40 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[663678a2-13ea-460d-bb13-2b8bceefc380]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:40 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:40 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:29:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0559939c-fed5-4473-b0eb-97f15133eea6 tempest-GroupSnapshotsTest-928428047 None] Delete group completed successfully. Jul 03 17:29:40 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 Jul 03 17:29:40 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:41 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.270s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9221ebac-e8b0-42fd-9d32-53b37fb7edbd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-23fda25f-85d9-4e75-99b1-9639916497a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f574b4f-bc7d-4679-9b1f-069b404879ec', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:29:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-371afe03-a030-4188-81bb-0af1a2f584d6 req-0950cdfb-c075-41d4-a167-2c6c23d1a09a tempest-AttachVolumeTestJSON-2098638241 None] attachment_update completed successfully. Jul 03 17:29:41 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:29:41 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-400c3f50-d39b-4d41-a9f9-71d15d135fee tempest-GroupSnapshotsTest-928428047 None] Group tempest-GroupSnapshotsTest-Group-270899603: creating Jul 03 17:29:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-400c3f50-d39b-4d41-a9f9-71d15d135fee tempest-GroupSnapshotsTest-928428047 None] Group tempest-GroupSnapshotsTest-Group-270899603: created successfully Jul 03 17:29:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-400c3f50-d39b-4d41-a9f9-71d15d135fee tempest-GroupSnapshotsTest-928428047 None] Create group completed successfully. Jul 03 17:29:42 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39841def-2073-4def-93ae-f4d33d640643]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:42 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:29:42 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:43 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.849s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.750fc323-c709-43b2-b5a2-8acfca5066dafqinblz5.img {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:43 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.750fc323-c709-43b2-b5a2-8acfca5066dafqinblz5.img Jul 03 17:29:43 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (9f0c6b04-c7ad-490d-86bf-e54d3f8205aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0d08b6-04ed-4943-a5e3-3787151d591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0d08b6-04ed-4943-a5e3-3787151d591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988728127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c2b66f-4205-4de9-af37-54d62db02c1d,host='devstack@QuobyteHD#QuobyteHD',id=00fe1bbf-0b44-4b06-b816-ff7bf149b891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:43Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39cf6b23-182c-4397-a6c8-2e66bd8d871a),volume_type_id=39cf6b23-182c-4397-a6c8-2e66bd8d871a)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8efe447-3530-4281-b2a5-637a22b61405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8efe447-3530-4281-b2a5-637a22b61405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8177cffc-d5b4-4310-979c-4e624ba2d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8177cffc-d5b4-4310-979c-4e624ba2d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fe1bbf-0b44-4b06-b816-ff7bf149b891', 'volume_name': 'volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50166c09-38cd-48d1-b56a-ccdce7fa988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50166c09-38cd-48d1-b56a-ccdce7fa988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f43932-e1d4-49d6-a31e-18eecdeb0bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:29:43 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Volume 00fe1bbf-0b44-4b06-b816-ff7bf149b891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891', 'volume_size': 1} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:29:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:43 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:29:43 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:45 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.584s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:29:45 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:29:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 9 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:29:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:29:49 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.750fc323-c709-43b2-b5a2-8acfca5066dafqinblz5.img" returned: 0 in 6.378s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ab2f5-3598-4f02-ae46-c3a523e393e6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:29:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:29:49 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:29:49 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:29:50 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Jul 03 17:29:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.991s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:29:50 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.750fc323-c709-43b2-b5a2-8acfca5066dafqinblz5.img {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:29:50 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Converted 1024.00 MB image at 160.53 MB/s Jul 03 17:29:50 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] 750fc323-c709-43b2-b5a2-8acfca5066da was raw, no need to convert to raw {{(pid=86621) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 03 17:30:00 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=72,cinder:INSERT=11,cinder:UPDATE=50 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:30:00 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=48,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.440s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Uploaded volume to glance image-id: 750fc323-c709-43b2-b5a2-8acfca5066da. {{(pid=86621) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.335s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95c2b66f-4205-4de9-af37-54d62db02c1d,created_at=2026-07-03T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988728127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c2b66f-4205-4de9-af37-54d62db02c1d,host='devstack@QuobyteHD#QuobyteHD',id=00fe1bbf-0b44-4b06-b816-ff7bf149b891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:29:43Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39cf6b23-182c-4397-a6c8-2e66bd8d871a),volume_type_id=39cf6b23-182c-4397-a6c8-2e66bd8d871a)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Creating volume 00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:30:14 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:30:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:14 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 1073741824 Jul 03 17:30:14 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:14 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d99ec14a-0cec-4faf-9ad0-ca78318d4947 tempest-VolumesActionsTest-1583959074 None] Copy volume to image completed successfully. Jul 03 17:30:15 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 1073741824" returned: 0 in 1.014s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:16 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 Jul 03 17:30:16 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:16 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891" returned: 0 in 0.704s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.366s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e63e0fe-1561-4583-bddd-e1753f4d2d56]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f43932-e1d4-49d6-a31e-18eecdeb0bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c29f633-e4d6-4ca1-a1ba-08ef3afbc020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Volume volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 (00fe1bbf-0b44-4b06-b816-ff7bf149b891): created successfully Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c29f633-e4d6-4ca1-a1ba-08ef3afbc020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (9f0c6b04-c7ad-490d-86bf-e54d3f8205aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:30:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d98356cc-6877-4d0d-b5cf-8cb4bf160fd3 tempest-GroupSnapshotsTest-928428047 None] Created volume successfully. Jul 03 17:30:16 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:30:16 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:17 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.734s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f6b395-987e-4158-9ef0-63f7099a46b5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:17 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:30:17 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:17 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:30:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (43d0b463-6bb7-41e2-b912-9253748caeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:30:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437dd25e-70d2-499c-bc1a-8f087e1523df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437dd25e-70d2-499c-bc1a-8f087e1523df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1793960111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c2b66f-4205-4de9-af37-54d62db02c1d,host='devstack@QuobyteHD#QuobyteHD',id=5d461b9f-d597-424a-a66d-980b4fcec2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:30:18Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39cf6b23-182c-4397-a6c8-2e66bd8d871a),volume_type_id=39cf6b23-182c-4397-a6c8-2e66bd8d871a)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee743730-e411-4755-bd61-6e048c7b22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee743730-e411-4755-bd61-6e048c7b22fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e594f064-998a-4587-ab02-582f139431f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e594f064-998a-4587-ab02-582f139431f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d461b9f-d597-424a-a66d-980b4fcec2a9', 'volume_name': 'volume-5d461b9f-d597-424a-a66d-980b4fcec2a9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cba9a8-e2f9-48ca-b065-7ae9975ed9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cba9a8-e2f9-48ca-b065-7ae9975ed9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c07ae1c-0b49-48ed-ae8b-27effe0e02f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Volume 5d461b9f-d597-424a-a66d-980b4fcec2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d461b9f-d597-424a-a66d-980b4fcec2a9', 'volume_size': 1} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:18 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.806s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:18 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img Jul 03 17:30:18 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:23 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img" returned: 0 in 5.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ec75fe-639f-4955-ac61-d899814b1111]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:24 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:30:24 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:24 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.933s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:24 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:30:24 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Converted 1024.00 MB image at 179.72 MB/s Jul 03 17:30:24 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] 038f03ff-0291-448e-a328-fc52e3863845 was raw, converting to qcow2 {{(pid=86621) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 03 17:30:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20811721-2dcc-4415-bf94-aec92f8ebaa9]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:25 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img Jul 03 17:30:25 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:25 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img" returned: 0 in 0.707s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:25 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img Jul 03 17:30:25 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:26 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img" returned: 1 in 0.757s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:30:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img /opt/stack/data/cinder/conversion/vol_upload_f9occuys {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:26 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img /opt/stack/data/cinder/conversion/vol_upload_f9occuys Jul 03 17:30:26 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:27 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img /opt/stack/data/cinder/conversion/vol_upload_f9occuys" returned: 0 in 0.666s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:27 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Image conversion details: src /opt/stack/data/cinder/conversion/da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef.temp_image.038f03ff-0291-448e-a328-fc52e3863845xodyu8uh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f9occuys {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:30:27 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 17:30:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[202c1a8d-6720-4238-95b3-7c9039558130]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9occuys {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:27 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9occuys Jul 03 17:30:27 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-f9613a2e-258a-45ae-ab98-9b6f4b9f1758 req-855fd409-d30d-4139-8bdb-0e8a62bd5a84 tempest-AttachVolumeTestJSON-2098638241 None] Terminate volume connection completed successfully. Jul 03 17:30:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-f9613a2e-258a-45ae-ab98-9b6f4b9f1758 req-855fd409-d30d-4139-8bdb-0e8a62bd5a84 tempest-AttachVolumeTestJSON-2098638241 None] Deleting attachment 7f574b4f-bc7d-4679-9b1f-069b404879ec. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:30:27 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9occuys" returned: 0 in 0.766s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-d6201ba9-4028-4991-8698-f0d6cbc81dfa req-92d9d9a8-545c-41d3-aefe-b70df640c8db tempest-AttachVolumeNegativeTest-20524444 None] Terminate volume connection completed successfully. Jul 03 17:30:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-d6201ba9-4028-4991-8698-f0d6cbc81dfa req-92d9d9a8-545c-41d3-aefe-b70df640c8db tempest-AttachVolumeNegativeTest-20524444 None] Deleting attachment 10b8f159-209b-4303-a4e4-6df57645bc3c. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.591s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Uploaded volume to glance image-id: 038f03ff-0291-448e-a328-fc52e3863845. {{(pid=86621) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.236s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95c2b66f-4205-4de9-af37-54d62db02c1d,created_at=2026-07-03T15:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1793960111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c2b66f-4205-4de9-af37-54d62db02c1d,host='devstack@QuobyteHD#QuobyteHD',id=5d461b9f-d597-424a-a66d-980b4fcec2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:30:18Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39cf6b23-182c-4397-a6c8-2e66bd8d871a),volume_type_id=39cf6b23-182c-4397-a6c8-2e66bd8d871a)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Creating volume 5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:30:29 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:30:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:29 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 1073741824 Jul 03 17:30:29 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4fab03e7-c682-4046-bdac-c955c439c8e5 tempest-VolumesActionsTest-1583959074 None] Copy volume to image completed successfully. Jul 03 17:30:30 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 1073741824" returned: 0 in 0.832s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:30 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 Jul 03 17:30:30 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Acquiring lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Acquiring lock "cinder-quobyte-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Lock "cinder-quobyte-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[001d9c55-a2b7-462b-9035-505a95bf9a68]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:31 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9" returned: 0 in 1.053s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:31 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:30:31 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c07ae1c-0b49-48ed-ae8b-27effe0e02f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d461b9f-d597-424a-a66d-980b4fcec2a9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f974edb8-db31-455a-8e8f-f4bd80585593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Volume volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 (5d461b9f-d597-424a-a66d-980b4fcec2a9): created successfully Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f974edb8-db31-455a-8e8f-f4bd80585593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (43d0b463-6bb7-41e2-b912-9253748caeda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:30:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-af13ff38-31dd-483a-92ae-69e5bed528e4 tempest-GroupSnapshotsTest-928428047 None] Created volume successfully. Jul 03 17:30:31 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.805s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:31 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef Jul 03 17:30:31 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:32 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c0dec3b1-0d3f-4416-b463-bf7c0ba0a056 tempest-GroupSnapshotsTest-928428047 None] Update group completed successfully. Jul 03 17:30:32 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" returned: 0 in 0.733s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Lock "cinder-quobyte-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef" released by "delete_volume" :: held 1.592s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Created reservations ['4fc931ee-674f-47cc-89af-733b54d90a70', '0d70aabe-a335-406a-8645-2142391104b0', '5b7f43ac-5c6e-4c17-a556-c812be2b999c', '61530702-8685-49c7-b149-d7be0d94816e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:32 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:30:32 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c67ee256-f17e-4aff-a7b8-fab5390fef8d tempest-GroupSnapshotsTest-928428047 None] Update group completed successfully. Jul 03 17:30:33 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.707s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:33 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:30:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Deleted volume successfully. Jul 03 17:30:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d42f5ebf-c6ed-4f3f-842a-defa2c3de11d tempest-VolumesActionsTest-1583959074 None] Lock "cinder-da2ff8c2-ca37-4f86-ba0c-ae4ca371ecef-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e9ffb10e-8583-489f-aff9-8e2bc32bf094 tempest-GroupSnapshotsTest-928428047 None] Update group completed successfully. Jul 03 17:30:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-37389ccb-e7c6-4b51-8106-cd26a7c0630e tempest-GroupSnapshotsTest-928428047 None] Update group completed successfully. Jul 03 17:30:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] GroupSnapshot 3740da2f-0db1-4b06-9599-07c552f3e2a8: creating. Jul 03 17:30:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Group snapshot 3740da2f-0db1-4b06-9599-07c552f3e2a8: creating. {{(pid=86621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 17:30:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Creating offline snapshot 7856a2be-21e6-4425-85ee-9c19bd0675cd of volume 00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:30:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432451d-15e4-4125-ac05-8eb5c0c17aa1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:37 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 Jul 03 17:30:37 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:38 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891" returned: 0 in 0.890s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:38 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd 1G Jul 03 17:30:38 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:39 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd 1G" returned: 0 in 0.926s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:39 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd Jul 03 17:30:39 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:39 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:30:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Flow 'volume_create_manager' (41a30c72-f053-49be-8bc6-ea7435540e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a352dc9-9e1f-4fe0-9b6c-93344506be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a352dc9-9e1f-4fe0-9b6c-93344506be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-914964358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf783bc0-23e8-4950-b638-063a508e2916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c688e841b3734342ba7e53736a41f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:30:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:30:40Z,use_quota=True,user_id='648bc2a8eb2f447dbc189c716780f065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adec421b-4295-48f1-a121-7940c8512175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adec421b-4295-48f1-a121-7940c8512175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c825fcf4-787d-4fe0-b82a-aaba94930466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c825fcf4-787d-4fe0-b82a-aaba94930466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf783bc0-23e8-4950-b638-063a508e2916', 'volume_name': 'volume-bf783bc0-23e8-4950-b638-063a508e2916', 'volume_size': 2}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ed991b-e756-44c0-864c-559a3017f1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ed991b-e756-44c0-864c-559a3017f1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa3d0b3-119d-423a-83e0-6f3214ecc661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Volume bf783bc0-23e8-4950-b638-063a508e2916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf783bc0-23e8-4950-b638-063a508e2916', 'volume_size': 2} Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:40 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd" returned: 0 in 0.864s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:40 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:30:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:40 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd Jul 03 17:30:40 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:41 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd" returned: 0 in 0.917s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:41 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info Jul 03 17:30:41 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:42 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info" returned: 0 in 1.153s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:42 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:30:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:42 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info Jul 03 17:30:42 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:43 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.info" returned: 0 in 0.701s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.613s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Creating offline snapshot eff24e1f-3eed-43f9-b73f-182e2144c967 of volume 5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7f06bb-d9cb-4cea-8743-38d61ff688d9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:43 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 Jul 03 17:30:43 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:43 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:30:43 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:44 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9" returned: 0 in 0.984s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:44 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 1G Jul 03 17:30:44 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:44 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.851s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:30:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:30:45 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 1G" returned: 0 in 0.949s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:45 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 Jul 03 17:30:45 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:45 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967" returned: 0 in 0.667s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:45 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:30:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:45 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 Jul 03 17:30:45 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:46 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967" returned: 0 in 0.610s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:46 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info Jul 03 17:30:46 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:47 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info" returned: 0 in 0.690s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:47 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:47 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info Jul 03 17:30:47 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:47 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.info" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.692s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.765s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-914964358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf783bc0-23e8-4950-b638-063a508e2916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c688e841b3734342ba7e53736a41f873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:30:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:30:40Z,use_quota=True,user_id='648bc2a8eb2f447dbc189c716780f065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Creating volume bf783bc0-23e8-4950-b638-063a508e2916 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:30:47 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:30:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 2147483648 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:47 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 2147483648 Jul 03 17:30:47 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a3e39e9-ba45-4ce8-9d07-d5582db9842b tempest-GroupSnapshotsTest-928428047 None] group_snapshot 3740da2f-0db1-4b06-9599-07c552f3e2a8: created successfully Jul 03 17:30:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 3740da2f-0db1-4b06-9599-07c552f3e2a8: deleting Jul 03 17:30:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 3740da2f-0db1-4b06-9599-07c552f3e2a8: deleting {{(pid=86621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-00fe1bbf-0b44-4b06-b816-ff7bf149b891" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-00fe1bbf-0b44-4b06-b816-ff7bf149b891" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-7856a2be-21e6-4425-85ee-9c19bd0675cd" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-7856a2be-21e6-4425-85ee-9c19bd0675cd" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Deleting offline snapshot 7856a2be-21e6-4425-85ee-9c19bd0675cd of volume 00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] snapshot_file for this snap is: volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692248a-1375-4283-a349-ab5bb83340ca]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:49 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd Jul 03 17:30:49 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:49 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 2147483648" returned: 0 in 2.028s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:50 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 Jul 03 17:30:50 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:50 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd" returned: 0 in 1.495s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:30:50 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd69fc2-7a26-4f51-adcf-36cbd54d2a3b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:51 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 Jul 03 17:30:51 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:51 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916" returned: 0 in 1.312s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] <== create_volume: return (3433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.440s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa3d0b3-119d-423a-83e0-6f3214ecc661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf783bc0-23e8-4950-b638-063a508e2916', 'volume_size': 2}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9443008-c795-4e23-9c45-9f3851d37aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:51 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Volume volume-bf783bc0-23e8-4950-b638-063a508e2916 (bf783bc0-23e8-4950-b638-063a508e2916): created successfully Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9443008-c795-4e23-9c45-9f3851d37aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Flow 'volume_create_manager' (41a30c72-f053-49be-8bc6-ea7435540e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:30:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4fb8b50e-f52f-43e6-8313-9fce7768bc87 tempest-VolumesCloneNegativeTest-992529015 None] Created volume successfully. Jul 03 17:30:51 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891" returned: 0 in 1.004s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:51 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd Jul 03 17:30:51 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Acquiring lock "cinder-bf783bc0-23e8-4950-b638-063a508e2916-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Lock "cinder-bf783bc0-23e8-4950-b638-063a508e2916-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Acquiring lock "cinder-quobyte-bf783bc0-23e8-4950-b638-063a508e2916" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Lock "cinder-quobyte-bf783bc0-23e8-4950-b638-063a508e2916" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cabd14c-ee8f-4718-b09a-95f79b6b1243]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:52 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 Jul 03 17:30:52 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:52 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd" returned: 0 in 0.911s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:52 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd Jul 03 17:30:52 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:53 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:53 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916 Jul 03 17:30:53 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:53 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891.7856a2be-21e6-4425-85ee-9c19bd0675cd" returned: 0 in 0.673s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-7856a2be-21e6-4425-85ee-9c19bd0675cd" released by "_delete_snapshot" :: held 4.251s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-00fe1bbf-0b44-4b06-b816-ff7bf149b891" released by "delete_snapshot" :: held 4.328s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-5d461b9f-d597-424a-a66d-980b4fcec2a9" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-5d461b9f-d597-424a-a66d-980b4fcec2a9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-eff24e1f-3eed-43f9-b73f-182e2144c967" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-eff24e1f-3eed-43f9-b73f-182e2144c967" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Deleting offline snapshot eff24e1f-3eed-43f9-b73f-182e2144c967 of volume 5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] snapshot_file for this snap is: volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11791821-7930-4ea3-98a8-857036649565]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:53 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 Jul 03 17:30:53 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:54 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bf783bc0-23e8-4950-b638-063a508e2916" returned: 0 in 0.819s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Lock "cinder-quobyte-bf783bc0-23e8-4950-b638-063a508e2916" released by "delete_volume" :: held 1.632s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Created reservations ['8e3b55c4-3c43-483e-a2e9-a4b8f658091b', 'c430d53d-c201-41fe-bb35-384256109117', 'c4d2724a-4cc7-41af-a880-67df83ec5e37', '937eabfb-488e-4d8a-b3b7-4fef16b19e91'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:54 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:30:54 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:54 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d461b9f-d597-424a-a66d-980b4fcec2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6696c-147e-40e3-9432-c55f1a41791b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:54 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 Jul 03 17:30:54 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:55 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.728s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:55 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:30:55 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Deleted volume successfully. Jul 03 17:30:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2ee1eb06-6c42-4fc9-9bcc-a32b67cccb41 tempest-VolumesCloneNegativeTest-992529015 None] Lock "cinder-bf783bc0-23e8-4950-b638-063a508e2916-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:55 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9" returned: 0 in 0.836s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:55 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 Jul 03 17:30:55 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:56 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967" returned: 0 in 0.817s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:56 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967 Jul 03 17:30:56 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:30:57 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 03 17:30:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9.eff24e1f-3eed-43f9-b73f-182e2144c967" returned: 0 in 1.137s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:30:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-eff24e1f-3eed-43f9-b73f-182e2144c967" released by "_delete_snapshot" :: held 3.813s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-5d461b9f-d597-424a-a66d-980b4fcec2a9" released by "delete_snapshot" :: held 3.849s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:30:57 devstack cinder-volume[86621]: WARNING cinder.quota [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-568178237 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-568178237, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:30:57 devstack cinder-volume[86621]: WARNING cinder.quota [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-568178237 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-568178237, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:30:57 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['1115e018-a1bc-46cb-94ed-0f64b32e2122', '226e819b-c3d2-4f43-9474-793d052c52d5', 'fc5c96ed-718a-4f51-a472-3e4e402193d0', '9ab15463-93e7-47a1-9574-201caca72f5a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:30:57 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] Created reservations ['088a63ce-2f53-40d4-88b6-624d648bc1d6', '3f2d0766-9254-44ee-af25-31835dcc4b3e', '4a247f1e-a78f-4c95-9931-30554203de94', '8c6da019-5287-4fb1-9fcf-453028a7c1b5'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:30:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-035f7488-2f71-406e-8381-e6a91522c544 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 3740da2f-0db1-4b06-9599-07c552f3e2a8: deleted successfully Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Flow 'volume_create_manager' (b5b8817e-dbca-4ead-9b01-9a0f1a19aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a38a8-e5ba-43d5-8288-e4775df11174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a38a8-e5ba-43d5-8288-e4775df11174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2029901369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdfffc5-4be2-471a-907d-bffa1b17ed30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4b0aaa3121488c873e4902ac69bcac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:30:59Z,use_quota=True,user_id='1c74abdbf7874e50bd28004a27992d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3f7150-0aa4-4326-858e-a0ab1f4ff8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3f7150-0aa4-4326-858e-a0ab1f4ff8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d355ed-3c8a-428c-b983-912a1564dcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d355ed-3c8a-428c-b983-912a1564dcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7bdfffc5-4be2-471a-907d-bffa1b17ed30', 'volume_name': 'volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1655e0-f9bf-4dc4-84a5-0695b3e701f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1655e0-f9bf-4dc4-84a5-0695b3e701f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3e4f0b-9339-4123-aca9-60811eded6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:30:59 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Volume 7bdfffc5-4be2-471a-907d-bffa1b17ed30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Trying to clone 7bdfffc5-4be2-471a-907d-bffa1b17ed30 from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-00fe1bbf-0b44-4b06-b816-ff7bf149b891" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-00fe1bbf-0b44-4b06-b816-ff7bf149b891" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757e7f9-c3a5-4e48-8ec8-89cebefe84fe]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:30:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:30:59 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 Jul 03 17:30:59 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:00 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:31:00 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Image download 20.69 MB at 20.69 MB/s Jul 03 17:31:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2992dba-a59b-4927-a221-1e6684f699ed]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:00 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD Jul 03 17:31:00 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:00 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891" returned: 0 in 0.912s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:00 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891 Jul 03 17:31:00 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:01 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD" returned: 0 in 0.910s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 is fetched for user 1c74abdbf7874e50bd28004a27992d99. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd26c54-076c-4d12-88ab-22b683616b46]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:01 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD Jul 03 17:31:01 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-00fe1bbf-0b44-4b06-b816-ff7bf149b891" returned: 0 in 1.104s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:01 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-00fe1bbf-0b44-4b06-b816-ff7bf149b891" released by "delete_volume" :: held 2.157s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-5d461b9f-d597-424a-a66d-980b4fcec2a9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-5d461b9f-d597-424a-a66d-980b4fcec2a9" acquired by "delete_volume" :: waited 0.053s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[892ad2bb-0405-4675-8675-8c535eeec183]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:02 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 Jul 03 17:31:02 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:02 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD" returned: 0 in 1.159s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2029901369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdfffc5-4be2-471a-907d-bffa1b17ed30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4b0aaa3121488c873e4902ac69bcac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:30:59Z,use_quota=True,user_id='1c74abdbf7874e50bd28004a27992d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Creating volume 7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:02 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:02 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 1073741824 Jul 03 17:31:02 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:03 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9" returned: 0 in 1.203s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:03 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9 Jul 03 17:31:03 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:03 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 1073741824" returned: 0 in 1.302s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:03 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:03 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:03 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d461b9f-d597-424a-a66d-980b4fcec2a9" returned: 0 in 0.852s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-5d461b9f-d597-424a-a66d-980b4fcec2a9" released by "delete_volume" :: held 2.153s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Created reservations ['3ed73558-dada-4ce0-a7bc-2401cd793959'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:04 devstack cinder-volume[86621]: WARNING cinder.quota [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-568178237 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-568178237, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Created reservations ['38c89c0b-a3ef-4777-8b8a-2e749e9b8d00', '9dfbdd9d-b9ef-4df0-86c7-825d1c73bcdb', '7f2f95d5-151c-4e87-bd15-c02bf06ea1d4', 'dd891e37-bd0a-443a-b068-aebb03b16bdf'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Created reservations ['91f7fdfa-aa21-462e-875d-e165e94bcf9d', '61b96523-859f-4a9c-8dbf-d34ec557162d', '6e10c8cb-3381-409c-8233-a24e71b7c269', 'd8f22d26-13fd-45f1-bbfe-d3300b707b51'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:04 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 0 in 0.849s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:04 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:31:04 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Attempting download of f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 7bdfffc5-4be2-471a-907d-bffa1b17ed30. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[89061b9a-04e3-4474-b810-a29d3ac62ce6]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:04 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf Jul 03 17:31:04 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-aa1a5abb-fa18-4919-8b5f-7d562b5b8b11 tempest-GroupSnapshotsTest-928428047 None] Group tempest-GroupSnapshotsTest-Group-1036741046: creating Jul 03 17:31:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-aa1a5abb-fa18-4919-8b5f-7d562b5b8b11 tempest-GroupSnapshotsTest-928428047 None] Group tempest-GroupSnapshotsTest-Group-1036741046: created successfully Jul 03 17:31:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-aa1a5abb-fa18-4919-8b5f-7d562b5b8b11 tempest-GroupSnapshotsTest-928428047 None] Create group completed successfully. Jul 03 17:31:05 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.176s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:05 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:31:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cafa62fb-e1d5-4177-825d-ddd7917d733c tempest-GroupSnapshotsTest-928428047 None] Delete group completed successfully. Jul 03 17:31:05 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf" returned: 0 in 1.063s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:06 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf Jul 03 17:31:06 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:06 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf" returned: 1 in 1.127s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_wwaycskf' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:31:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28db858-9d64-4744-b9e8-45ea6efe850a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:07 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD Jul 03 17:31:07 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (2f615989-7273-4ecd-ade9-c64cc4167217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e306f7-d37e-40b2-a31c-de0f8fe906bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e306f7-d37e-40b2-a31c-de0f8fe906bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-962786381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38e55a1f-d58d-41e1-8e9f-e9a89364fa1a,host='devstack@QuobyteHD#QuobyteHD',id=79b72729-627c-49d6-8ac9-c63d6e274f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:07Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbbb62d7-591e-455e-8604-f85d50726924),volume_type_id=fbbb62d7-591e-455e-8604-f85d50726924)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9ffdf4-495c-4f0b-b6d8-a0dd39db64ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9ffdf4-495c-4f0b-b6d8-a0dd39db64ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3776d278-72dd-419c-a3c0-fb4b4b2dd386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3776d278-72dd-419c-a3c0-fb4b4b2dd386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b72729-627c-49d6-8ac9-c63d6e274f6f', 'volume_name': 'volume-79b72729-627c-49d6-8ac9-c63d6e274f6f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63d7966-4c59-4654-b46b-065981ba896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63d7966-4c59-4654-b46b-065981ba896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfa581d-a441-4428-925d-52afbc4dea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Volume 79b72729-627c-49d6-8ac9-c63d6e274f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b72729-627c-49d6-8ac9-c63d6e274f6f', 'volume_size': 1} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38e55a1f-d58d-41e1-8e9f-e9a89364fa1a,created_at=2026-07-03T15:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-962786381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38e55a1f-d58d-41e1-8e9f-e9a89364fa1a,host='devstack@QuobyteHD#QuobyteHD',id=79b72729-627c-49d6-8ac9-c63d6e274f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571c06a5c4b45dcab32dd9f9e0fc11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:07Z,use_quota=True,user_id='6ea6a1adfacb454a86330db987236de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbbb62d7-591e-455e-8604-f85d50726924),volume_type_id=fbbb62d7-591e-455e-8604-f85d50726924)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Creating volume 79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:07 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:07 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f 1073741824 Jul 03 17:31:07 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:07 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD" returned: 0 in 1.038s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] f57dcfb6-0eab-4021-8a48-1dea93bf40e3 was qcow2, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:31:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:08 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:08 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:08 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f 1073741824" returned: 0 in 1.297s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:08 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f Jul 03 17:31:08 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:09 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f" returned: 0 in 0.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfa581d-a441-4428-925d-52afbc4dea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b72729-627c-49d6-8ac9-c63d6e274f6f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b12b1a0-5450-4a34-a9d2-58357aef22d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Volume volume-79b72729-627c-49d6-8ac9-c63d6e274f6f (79b72729-627c-49d6-8ac9-c63d6e274f6f): created successfully Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b12b1a0-5450-4a34-a9d2-58357aef22d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Flow 'volume_create_manager' (2f615989-7273-4ecd-ade9-c64cc4167217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cdce3572-d6cc-4540-b742-c4e3386ac255 tempest-GroupSnapshotsTest-928428047 None] Created volume successfully. Jul 03 17:31:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] GroupSnapshot 02d8f40e-5851-40da-8890-96c6abab6f06: creating. Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Group snapshot 02d8f40e-5851-40da-8890-96c6abab6f06: creating. {{(pid=86621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Creating offline snapshot 5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 of volume 79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b0dda-d08f-457c-b924-15a7fad8b8df]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:10 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f Jul 03 17:31:10 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:10 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 0 in 2.431s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_d_3yhcqadevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:31:10 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Converted 112.00 MB image at 46.06 MB/s Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:10 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 1G Jul 03 17:31:10 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:10 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f" returned: 0 in 0.785s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:10 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 1G Jul 03 17:31:10 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:11 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 1G" returned: 0 in 0.691s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ef717-6c1d-4b2d-aa55-13255ef6e89b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:11 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:11 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:11 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 1G" returned: 0 in 0.822s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b72729-627c-49d6-8ac9-c63d6e274f6f -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:11 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b72729-627c-49d6-8ac9-c63d6e274f6f -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 Jul 03 17:31:11 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:11 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 0 in 0.833s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:12 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:12 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:12 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b72729-627c-49d6-8ac9-c63d6e274f6f -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" returned: 0 in 0.741s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:12 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:12 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 Jul 03 17:31:12 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:12 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 1 in 0.785s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Downloaded image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 7bdfffc5-4be2-471a-907d-bffa1b17ed30 successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 for user 1c74abdbf7874e50bd28004a27992d99 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Marking volume 7bdfffc5-4be2-471a-907d-bffa1b17ed30 as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=77,cinder:UPDATE=69,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Copying metadata from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 to 7bdfffc5-4be2-471a-907d-bffa1b17ed30. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Creating volume glance metadata for volume 7bdfffc5-4be2-471a-907d-bffa1b17ed30 backed by image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=74,cinder:INSERT=23,cinder:SELECT=63,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3e4f0b-9339-4123-aca9-60811eded6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4da091-7a9f-4e6d-b097-7bf103449985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:12 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Volume volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 (7bdfffc5-4be2-471a-907d-bffa1b17ed30): created successfully Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4da091-7a9f-4e6d-b097-7bf103449985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Flow 'volume_create_manager' (b5b8817e-dbca-4ead-9b01-9a0f1a19aad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:12 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6605aa34-3af7-42ef-bc18-8c7ec8193492 tempest-VolumesExtendTest-270081245 None] Created volume successfully. Jul 03 17:31:13 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" returned: 0 in 0.686s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:13 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info Jul 03 17:31:13 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:13 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info" returned: 0 in 0.712s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:13 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:31:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:13 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info Jul 03 17:31:13 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:14 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.info" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.492s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.979s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:14 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f05094-b891-4f90-b4c0-72008f5f0fc0]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:14 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-620815e2-ea5c-4e38-ba55-c84fe349e084 tempest-GroupSnapshotsTest-928428047 None] group_snapshot 02d8f40e-5851-40da-8890-96c6abab6f06: created successfully Jul 03 17:31:14 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:14 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:15 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 0 in 0.768s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] group_snapshot 02d8f40e-5851-40da-8890-96c6abab6f06: deleting Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] group_snapshot 02d8f40e-5851-40da-8890-96c6abab6f06: deleting {{(pid=86621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 17:31:15 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:15 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-79b72729-627c-49d6-8ac9-c63d6e274f6f" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-79b72729-627c-49d6-8ac9-c63d6e274f6f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Deleting offline snapshot 5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 of volume 79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] snapshot_file for this snap is: volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad767be2-a51c-475e-9895-37e882b9b36b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:15 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 Jul 03 17:31:15 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:16 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 1 in 0.868s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 2G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 2G" returned: 0 in 0.083s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.772s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0ad62b21-c023-4c0b-a902-745a11c92435 tempest-VolumesExtendTest-270081245 None] Extend volume completed successfully. Jul 03 17:31:16 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" returned: 0 in 0.857s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b72729-627c-49d6-8ac9-c63d6e274f6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a506d28-fb5d-4deb-a309-a5b9d650fe79]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:16 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f Jul 03 17:31:16 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-7bdfffc5-4be2-471a-907d-bffa1b17ed30-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Lock "cinder-7bdfffc5-4be2-471a-907d-bffa1b17ed30-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-quobyte-7bdfffc5-4be2-471a-907d-bffa1b17ed30" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-7bdfffc5-4be2-471a-907d-bffa1b17ed30" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97fd127-41b3-4ae1-b79e-234ab33b1966]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:17 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:17 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:17 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f" returned: 0 in 0.847s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:17 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 Jul 03 17:31:17 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:18 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 0 in 0.825s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:18 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:18 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:18 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" returned: 0 in 0.856s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:18 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70 Jul 03 17:31:18 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:18 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 1 in 0.868s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:18 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f.5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:18 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30 Jul 03 17:31:18 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-5121b2fb-713d-4ed4-ab9f-88bb7d1c5f70" released by "_delete_snapshot" :: held 3.411s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-79b72729-627c-49d6-8ac9-c63d6e274f6f" released by "delete_snapshot" :: held 3.455s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:19 devstack cinder-volume[86621]: WARNING cinder.quota [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-975355094 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-975355094, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:19 devstack cinder-volume[86621]: WARNING cinder.quota [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-975355094 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-975355094, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] Created reservations ['c3cf0e2a-ac38-4dee-a5b6-f6d2f95e25f7', '249111e3-4217-4c71-8064-d7e27c6d8f22', '555b169d-1636-40be-9ba8-e68047497a6c', 'c3c5d019-e3f6-49a1-b661-e4dbbecdae8e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:19 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9d3127bb-0423-452f-93a4-469e292a0fff tempest-GroupSnapshotsTest-928428047 None] group_snapshot 02d8f40e-5851-40da-8890-96c6abab6f06: deleted successfully Jul 03 17:31:19 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7bdfffc5-4be2-471a-907d-bffa1b17ed30" returned: 0 in 0.645s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-7bdfffc5-4be2-471a-907d-bffa1b17ed30" released by "delete_volume" :: held 2.412s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Created reservations ['0d8a6f4f-4a2f-4be3-a8a2-78fd85d8480a', 'e5486619-d227-454a-9751-9d2349a8c469', '14f3b019-aa5c-4e2a-8cc8-512f0e4c9763', '0ed0b25c-c162-4e66-bb8d-514a72c7ddb7'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:19 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:31:19 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "cinder-quobyte-79b72729-627c-49d6-8ac9-c63d6e274f6f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-79b72729-627c-49d6-8ac9-c63d6e274f6f" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3e5df2-1a9e-40a5-8502-c224c5c134be]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:20 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:31:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Deleted volume successfully. Jul 03 17:31:20 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f Jul 03 17:31:20 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-822ded3b-d23d-4118-9d55-28ec63b30d20 tempest-VolumesExtendTest-270081245 None] Lock "cinder-7bdfffc5-4be2-471a-907d-bffa1b17ed30-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:20 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Flow 'volume_create_manager' (17cf7cda-4fc7-4440-b00e-f93885b9f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b097625-d684-4bfa-918b-561faa6c1868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b097625-d684-4bfa-918b-561faa6c1868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1166717430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458b24c9-e81d-4e54-8588-585468891d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4b0aaa3121488c873e4902ac69bcac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:21Z,use_quota=True,user_id='1c74abdbf7874e50bd28004a27992d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25712cb2-a359-4ce5-94cd-62f8c99dda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25712cb2-a359-4ce5-94cd-62f8c99dda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a6bdd9-1454-4c8e-9375-87998ca24a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a6bdd9-1454-4c8e-9375-87998ca24a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458b24c9-e81d-4e54-8588-585468891d7d', 'volume_name': 'volume-458b24c9-e81d-4e54-8588-585468891d7d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec001db-b366-4877-85ca-cbdc611faabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec001db-b366-4877-85ca-cbdc611faabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923b03f7-5707-49a7-96b5-ecc6d8b1877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Volume 458b24c9-e81d-4e54-8588-585468891d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458b24c9-e81d-4e54-8588-585468891d7d', 'volume_size': 1} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1166717430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458b24c9-e81d-4e54-8588-585468891d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4b0aaa3121488c873e4902ac69bcac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:21Z,use_quota=True,user_id='1c74abdbf7874e50bd28004a27992d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Creating volume 458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:21 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:21 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f" returned: 0 in 0.850s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:21 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d 1073741824 Jul 03 17:31:21 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:21 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f Jul 03 17:31:21 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:21 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-79b72729-627c-49d6-8ac9-c63d6e274f6f" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Lock "cinder-quobyte-79b72729-627c-49d6-8ac9-c63d6e274f6f" released by "delete_volume" :: held 1.735s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:22 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Created reservations ['e167b68b-6d11-4711-8661-2717e7e06cc2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d 1073741824" returned: 0 in 1.007s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:22 devstack cinder-volume[86621]: WARNING cinder.quota [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-975355094 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-975355094, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:22 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d Jul 03 17:31:22 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Created reservations ['bf59106f-7e68-400a-b30d-de9d641b356f', '96180624-20b4-4954-8f1e-a11ec020a43f', 'fc0a8f75-289b-44db-81a5-a9fa7cbaa293', '51277c7c-dc03-4470-ad2a-498f5a7617e8'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:22 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:31:22 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Flow 'volume_create_manager' (70f06641-dc7a-4579-a250-01d87ece70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d082ee59-8b63-4156-97c1-4cca0e9b5d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d082ee59-8b63-4156-97c1-4cca0e9b5d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-788942927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5905800-dfa8-43db-9263-730c872a47ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438abfdbed64fee9c8f053f14d02747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:23Z,use_quota=True,user_id='195c65867a6b47ef924a3ad4e190ee54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7979a5-0816-43fb-a3a1-c57b553b38bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7979a5-0816-43fb-a3a1-c57b553b38bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a2c2b1-bd51-4b60-876e-c046d49d72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a2c2b1-bd51-4b60-876e-c046d49d72b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5905800-dfa8-43db-9263-730c872a47ac', 'volume_name': 'volume-e5905800-dfa8-43db-9263-730c872a47ac', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6deab2f-7189-43d4-bae0-0061e41216c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6deab2f-7189-43d4-bae0-0061e41216c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80871e6-8cff-4c11-b79c-0eebfac483e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Volume e5905800-dfa8-43db-9263-730c872a47ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5905800-dfa8-43db-9263-730c872a47ac', 'volume_size': 1} Jul 03 17:31:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:23 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d" returned: 0 in 1.238s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-788942927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5905800-dfa8-43db-9263-730c872a47ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438abfdbed64fee9c8f053f14d02747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:23Z,use_quota=True,user_id='195c65867a6b47ef924a3ad4e190ee54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Creating volume e5905800-dfa8-43db-9263-730c872a47ac {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:23 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:23 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac 1073741824 Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923b03f7-5707-49a7-96b5-ecc6d8b1877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458b24c9-e81d-4e54-8588-585468891d7d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:23 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:23 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c8348e-86a0-4902-8f78-015b2fb346c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.080s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:31:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3218e70b-9c25-4141-9a74-cb30891fdace tempest-GroupSnapshotsTest-928428047 None] Delete group completed successfully. Jul 03 17:31:23 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Volume volume-458b24c9-e81d-4e54-8588-585468891d7d (458b24c9-e81d-4e54-8588-585468891d7d): created successfully Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c8348e-86a0-4902-8f78-015b2fb346c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Flow 'volume_create_manager' (17cf7cda-4fc7-4440-b00e-f93885b9f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-56986357-baa4-4edf-8784-d9b7ad78d178 tempest-VolumesExtendTest-270081245 None] Created volume successfully. Jul 03 17:31:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:24 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac 1073741824" returned: 0 in 1.102s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:24 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac Jul 03 17:31:24 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:25 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac" returned: 0 in 0.774s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.927s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80871e6-8cff-4c11-b79c-0eebfac483e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5905800-dfa8-43db-9263-730c872a47ac', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc813b6-23fc-4396-9540-93fa1511ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Creating offline snapshot 7ce52ffa-c245-4f6b-b02c-45a068f8442b of volume 458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:31:25 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Volume volume-e5905800-dfa8-43db-9263-730c872a47ac (e5905800-dfa8-43db-9263-730c872a47ac): created successfully Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc813b6-23fc-4396-9540-93fa1511ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Flow 'volume_create_manager' (70f06641-dc7a-4579-a250-01d87ece70e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f854268f-6fa0-4af8-9f1e-8f24365793f7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5bb9eb1f-c06e-4530-b809-8f1a31455c2a tempest-AttachVolumeNegativeTest-20524444 None] Created volume successfully. Jul 03 17:31:25 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d Jul 03 17:31:25 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:26 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d" returned: 0 in 0.829s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:26 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b 1G Jul 03 17:31:26 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:27 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b 1G" returned: 0 in 0.925s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458b24c9-e81d-4e54-8588-585468891d7d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:27 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458b24c9-e81d-4e54-8588-585468891d7d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b Jul 03 17:31:27 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:27 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458b24c9-e81d-4e54-8588-585468891d7d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b" returned: 0 in 0.765s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:27 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b is being set with open permissions: ugo+rw Jul 03 17:31:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:27 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b Jul 03 17:31:27 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-211e8d5c-bc40-42f2-8494-2cb654c85654 tempest-GroupSnapshotsV319Test-1011308952 None] Group tempest-GroupSnapshotsV319Test-Group-1406547892: creating Jul 03 17:31:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-211e8d5c-bc40-42f2-8494-2cb654c85654 tempest-GroupSnapshotsV319Test-1011308952 None] Group tempest-GroupSnapshotsV319Test-Group-1406547892: created successfully Jul 03 17:31:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-211e8d5c-bc40-42f2-8494-2cb654c85654 tempest-GroupSnapshotsV319Test-1011308952 None] Create group completed successfully. Jul 03 17:31:28 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b" returned: 0 in 0.660s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:28 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info Jul 03 17:31:28 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:29 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info" returned: 0 in 0.855s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:29 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info is being set with open permissions: ugo+rw Jul 03 17:31:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:29 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info Jul 03 17:31:29 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Flow 'volume_create_manager' (35913fee-15d1-447b-9660-419ce06e3c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f05fd0-5325-4ccf-bfa1-aa97ee615640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f05fd0-5325-4ccf-bfa1-aa97ee615640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375373139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dac44d3-e2d6-4d3e-811e-fb991ad21e15,host='devstack@QuobyteHD#QuobyteHD',id=76ba12ac-da37-4549-8a41-91a442f5dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9854124c8ff146919af06832aa3c670b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:30Z,use_quota=True,user_id='afbddda9660540e58556d198b9f7046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79070c6f-4816-43b3-b91b-ee0c296fce23),volume_type_id=79070c6f-4816-43b3-b91b-ee0c296fce23)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76f97e6-0a8b-47cd-a1f5-a62126db1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76f97e6-0a8b-47cd-a1f5-a62126db1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a08787-99ae-46e9-bfe3-0999ddded2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a08787-99ae-46e9-bfe3-0999ddded2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ba12ac-da37-4549-8a41-91a442f5dc6b', 'volume_name': 'volume-76ba12ac-da37-4549-8a41-91a442f5dc6b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fca4c7-7fde-45f6-ae5d-53041a471b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fca4c7-7fde-45f6-ae5d-53041a471b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511bb2d0-2dca-4d39-b21a-35086c6573cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Volume 76ba12ac-da37-4549-8a41-91a442f5dc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ba12ac-da37-4549-8a41-91a442f5dc6b', 'volume_size': 1} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:30 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.info" returned: 0 in 1.228s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.380s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.787s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de8eca1-8d47-4359-b73d-13a069954fa2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e99bcf1e-30e3-471a-bcc8-4a00b13cfb03 tempest-VolumesExtendTest-270081245 None] Create snapshot completed successfully Jul 03 17:31:30 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac Jul 03 17:31:30 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:31 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3dac44d3-e2d6-4d3e-811e-fb991ad21e15,created_at=2026-07-03T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-375373139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dac44d3-e2d6-4d3e-811e-fb991ad21e15,host='devstack@QuobyteHD#QuobyteHD',id=76ba12ac-da37-4549-8a41-91a442f5dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9854124c8ff146919af06832aa3c670b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:30Z,use_quota=True,user_id='afbddda9660540e58556d198b9f7046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79070c6f-4816-43b3-b91b-ee0c296fce23),volume_type_id=79070c6f-4816-43b3-b91b-ee0c296fce23)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Creating volume 76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:31 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:31 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b 1073741824 Jul 03 17:31:31 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-e5905800-dfa8-43db-9263-730c872a47ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6489733-a7cf-4c69-abde-5f59f4ddf3ae', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:31:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-275d61c4-27d7-4522-b255-52903979e383 req-01ca4212-d8e4-4d94-ad2c-c741efdf15c7 tempest-AttachVolumeNegativeTest-20524444 None] attachment_update completed successfully. Jul 03 17:31:32 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b 1073741824" returned: 0 in 1.070s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:32 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b Jul 03 17:31:32 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:33 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b" returned: 0 in 0.806s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.983s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511bb2d0-2dca-4d39-b21a-35086c6573cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ba12ac-da37-4549-8a41-91a442f5dc6b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c084e8e5-9477-45e2-8906-b228612e2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b699999-985d-439d-98cb-ccfa88846c19]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Volume volume-76ba12ac-da37-4549-8a41-91a442f5dc6b (76ba12ac-da37-4549-8a41-91a442f5dc6b): created successfully Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c084e8e5-9477-45e2-8906-b228612e2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Flow 'volume_create_manager' (35913fee-15d1-447b-9660-419ce06e3c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b96832f3-35f5-47b2-93cd-57524a522449 tempest-GroupSnapshotsV319Test-1011308952 None] Created volume successfully. Jul 03 17:31:33 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d Jul 03 17:31:33 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:34 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d" returned: 0 in 0.958s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b 2G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] GroupSnapshot 7c885da7-5e90-48d2-aa53-5febbe278a10: creating. Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Group snapshot 7c885da7-5e90-48d2-aa53-5febbe278a10: creating. {{(pid=86621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b 2G" returned: 0 in 0.197s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.205s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.126s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Creating offline snapshot 7ff239be-c8be-4737-9ebc-1b25736f4b95 of volume 76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c501a93-99c7-47fa-b3b6-d8cceced8498]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-857f0503-73ad-4611-abc9-03233dd0fe69 tempest-VolumesExtendTest-270081245 None] Extend volume completed successfully. Jul 03 17:31:34 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b Jul 03 17:31:34 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:35 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b" returned: 0 in 0.862s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:35 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 1G Jul 03 17:31:35 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-7ce52ffa-c245-4f6b-b02c-45a068f8442b-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Lock "cinder-7ce52ffa-c245-4f6b-b02c-45a068f8442b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-quobyte-458b24c9-e81d-4e54-8588-585468891d7d" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-458b24c9-e81d-4e54-8588-585468891d7d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-quobyte-7ce52ffa-c245-4f6b-b02c-45a068f8442b" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-7ce52ffa-c245-4f6b-b02c-45a068f8442b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Deleting offline snapshot 7ce52ffa-c245-4f6b-b02c-45a068f8442b of volume 458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] snapshot_file for this snap is: volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c1700-6aa1-4367-a506-2ab5e99b149d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:36 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b Jul 03 17:31:36 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:36 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 1G" returned: 0 in 1.035s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ba12ac-da37-4549-8a41-91a442f5dc6b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:36 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ba12ac-da37-4549-8a41-91a442f5dc6b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 Jul 03 17:31:36 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:37 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b" returned: 0 in 1.025s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-458b24c9-e81d-4e54-8588-585468891d7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:31:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c5afc-6538-44f7-9945-8d37c1efd17a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:37 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d Jul 03 17:31:37 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:37 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ba12ac-da37-4549-8a41-91a442f5dc6b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95" returned: 0 in 0.739s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:37 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:31:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:37 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 Jul 03 17:31:37 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:37 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d" returned: 0 in 0.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:38 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95" returned: 0 in 0.682s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:38 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b Jul 03 17:31:38 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:38 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info Jul 03 17:31:38 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-3521e6bf-3ff7-490d-92aa-f6701039ea5f req-445a9f0c-c947-4960-8d39-35df2c9acc25 tempest-AttachVolumeNegativeTest-20524444 None] Terminate volume connection completed successfully. Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-3521e6bf-3ff7-490d-92aa-f6701039ea5f req-445a9f0c-c947-4960-8d39-35df2c9acc25 tempest-AttachVolumeNegativeTest-20524444 None] Deleting attachment b6489733-a7cf-4c69-abde-5f59f4ddf3ae. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:31:38 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info" returned: 0 in 0.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:38 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:38 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info Jul 03 17:31:38 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:38 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b" returned: 0 in 0.978s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:39 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b Jul 03 17:31:39 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:39 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.info" returned: 0 in 0.656s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.812s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ba3f5120-f3a0-4c71-8946-dd9b89535f8a tempest-GroupSnapshotsV319Test-1011308952 None] group_snapshot 7c885da7-5e90-48d2-aa53-5febbe278a10: created successfully Jul 03 17:31:39 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d.7ce52ffa-c245-4f6b-b02c-45a068f8442b" returned: 0 in 0.705s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-7ce52ffa-c245-4f6b-b02c-45a068f8442b" released by "_delete_snapshot" :: held 3.635s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-458b24c9-e81d-4e54-8588-585468891d7d" released by "delete_snapshot" :: held 3.659s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Created reservations ['5a5f66f8-8311-4970-98f2-54dde18d0d5b', 'f050af73-5b1d-44f2-a3c2-b7faca49c9da', '264258c2-646c-4488-bb3d-540e7c53d9e3', 'a40279c4-20cd-4567-96ef-94f5f31886ff'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Delete snapshot completed successfully. Jul 03 17:31:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2811930-08d7-4316-a0b7-a6fc675b4e19 tempest-VolumesExtendTest-270081245 None] Lock "cinder-7ce52ffa-c245-4f6b-b02c-45a068f8442b-delete_snapshot" released by "delete_snapshot" :: held 3.839s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] group_snapshot 7c885da7-5e90-48d2-aa53-5febbe278a10: deleting Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] group_snapshot 7c885da7-5e90-48d2-aa53-5febbe278a10: deleting {{(pid=86621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "cinder-quobyte-76ba12ac-da37-4549-8a41-91a442f5dc6b" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-458b24c9-e81d-4e54-8588-585468891d7d-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Lock "cinder-quobyte-76ba12ac-da37-4549-8a41-91a442f5dc6b" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "cinder-quobyte-7ff239be-c8be-4737-9ebc-1b25736f4b95" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Lock "cinder-quobyte-7ff239be-c8be-4737-9ebc-1b25736f4b95" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Deleting offline snapshot 7ff239be-c8be-4737-9ebc-1b25736f4b95 of volume 76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] snapshot_file for this snap is: volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Lock "cinder-458b24c9-e81d-4e54-8588-585468891d7d-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e98338c-4301-4934-a1b7-8b7bc4abf423]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Acquiring lock "cinder-quobyte-458b24c9-e81d-4e54-8588-585468891d7d" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-458b24c9-e81d-4e54-8588-585468891d7d" acquired by "delete_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9f2d52-9ec2-44dd-9101-f53f51957f32]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:40 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 Jul 03 17:31:40 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:40 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d Jul 03 17:31:40 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:41 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95" returned: 0 in 0.910s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ba12ac-da37-4549-8a41-91a442f5dc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:31:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b6abc2-0b6f-4120-b013-98386f4134ed]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:41 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d" returned: 0 in 0.864s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:41 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d Jul 03 17:31:41 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:41 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b Jul 03 17:31:41 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:42 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-458b24c9-e81d-4e54-8588-585468891d7d" returned: 0 in 1.237s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Lock "cinder-quobyte-458b24c9-e81d-4e54-8588-585468891d7d" released by "delete_volume" :: held 2.186s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Created reservations ['e0d5de52-ec19-49e7-b851-90faf7e50aa4', 'd6cbe016-43bc-4e9e-ba6a-5f2a85bab0fb', '43126d9f-fb60-4de7-90c7-d96669ea84e2', 'd4715a0d-b70c-4be2-8cbf-e29d19304f15'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:42 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b" returned: 0 in 1.461s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:42 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 Jul 03 17:31:42 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:43 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:31:43 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:43 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.662s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:31:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Deleted volume successfully. Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8e782eb3-2e71-4911-a358-5b03ef4a0684 tempest-VolumesExtendTest-270081245 None] Lock "cinder-458b24c9-e81d-4e54-8588-585468891d7d-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:43 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95" returned: 0 in 0.792s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:43 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:31:43 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:43 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95 Jul 03 17:31:43 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:44 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.829s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:31:44 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b.7ff239be-c8be-4737-9ebc-1b25736f4b95" returned: 0 in 0.837s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Lock "cinder-quobyte-7ff239be-c8be-4737-9ebc-1b25736f4b95" released by "_delete_snapshot" :: held 4.173s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Lock "cinder-quobyte-76ba12ac-da37-4549-8a41-91a442f5dc6b" released by "delete_snapshot" :: held 4.220s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:44 devstack cinder-volume[86621]: WARNING cinder.quota [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-270477931 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-270477931, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:44 devstack cinder-volume[86621]: WARNING cinder.quota [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-270477931 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-270477931, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:44 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] Created reservations ['91375cd5-84c0-49ec-98de-b13693ea0823', '89671408-160a-497f-b574-053aa7ccb867', 'f8748907-ccd5-49ed-8fa9-b3c0ae0c878a', '97bf956f-2374-4e79-b74f-599b57f607a2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a20a3fb5-51d1-472d-833a-48429b4d025e tempest-GroupSnapshotsV319Test-1011308952 None] group_snapshot 7c885da7-5e90-48d2-aa53-5febbe278a10: deleted successfully Jul 03 17:31:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "cinder-quobyte-76ba12ac-da37-4549-8a41-91a442f5dc6b" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "cinder-quobyte-76ba12ac-da37-4549-8a41-91a442f5dc6b" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d5a94-3605-45ce-8694-e109eddb496c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:45 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b Jul 03 17:31:45 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:46 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b" returned: 0 in 0.816s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:46 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b Jul 03 17:31:46 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:46 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-76ba12ac-da37-4549-8a41-91a442f5dc6b" returned: 0 in 0.643s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "cinder-quobyte-76ba12ac-da37-4549-8a41-91a442f5dc6b" released by "delete_volume" :: held 1.551s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Created reservations ['e38d7693-c83b-43d2-a2b4-9f3d22f7a67e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:46 devstack cinder-volume[86621]: WARNING cinder.quota [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-270477931 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-270477931, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Created reservations ['3ccc54b8-9763-4600-b017-08cca69aa450', 'd108f07f-974b-4dbf-856f-4f9fda809ab2', 'a94211bf-4e73-456b-95e2-60fe9b146f04', '6388ec90-1a43-4b6e-b310-3f6368ba3786'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Flow 'volume_create_manager' (f0393e3a-9aa3-40f6-ba41-81d1b5d626a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990655a3-9bf9-4fc7-9b05-8271b7293039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990655a3-9bf9-4fc7-9b05-8271b7293039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-230499550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ec133a-ec15-43ee-9de3-1e308d3da9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5828b0dea9d948d98ce55e0479defafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:47Z,use_quota=True,user_id='9c1f6247ab5546cb88735f9291935ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dba354-3d44-4b37-b56b-8a16aa4e46d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dba354-3d44-4b37-b56b-8a16aa4e46d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d33619a-7dbe-4d63-96b9-33efc65272b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d33619a-7dbe-4d63-96b9-33efc65272b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ec133a-ec15-43ee-9de3-1e308d3da9b2', 'volume_name': 'volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2250562-aea6-4932-8d6b-17f7053d236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2250562-aea6-4932-8d6b-17f7053d236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5851661-516d-4993-bd33-f583620818c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:47 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Volume 41ec133a-ec15-43ee-9de3-1e308d3da9b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2', 'volume_size': 1} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-230499550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ec133a-ec15-43ee-9de3-1e308d3da9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5828b0dea9d948d98ce55e0479defafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:47Z,use_quota=True,user_id='9c1f6247ab5546cb88735f9291935ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Creating volume 41ec133a-ec15-43ee-9de3-1e308d3da9b2 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:47 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:47 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 1073741824 Jul 03 17:31:47 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:47 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:31:47 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:47 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.677s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:31:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-117e13ca-2b1b-4add-9c6c-9ce718b55da0 tempest-GroupSnapshotsV319Test-1011308952 None] Delete group completed successfully. Jul 03 17:31:47 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 1073741824" returned: 0 in 0.912s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:48 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 Jul 03 17:31:48 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:48 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2" returned: 0 in 0.854s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5851661-516d-4993-bd33-f583620818c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e89b95-8312-49b2-b6bc-b5bd253aa93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Volume volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 (41ec133a-ec15-43ee-9de3-1e308d3da9b2): created successfully Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e89b95-8312-49b2-b6bc-b5bd253aa93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Flow 'volume_create_manager' (f0393e3a-9aa3-40f6-ba41-81d1b5d626a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ce8c5a8c-257f-4a8c-a726-af248736c704 tempest-VolumesNegativeTest-132242985 None] Created volume successfully. Jul 03 17:31:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-df5c1de5-3910-49fd-9178-d90e0b28d690 tempest-GroupsTest-524099125 None] Group tempest-Group1-216039017: creating Jul 03 17:31:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-df5c1de5-3910-49fd-9178-d90e0b28d690 tempest-GroupsTest-524099125 None] Group tempest-Group1-216039017: created successfully Jul 03 17:31:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-df5c1de5-3910-49fd-9178-d90e0b28d690 tempest-GroupsTest-524099125 None] Create group completed successfully. Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Flow 'volume_create_manager' (d8b0ae77-0d93-48eb-9543-2790740b28ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba2d88-945d-4142-8635-05ebf8c1563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba2d88-945d-4142-8635-05ebf8c1563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-507849285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb5b3a8-eeab-458f-80ba-af1e02ca922f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e28cfbf841b472596d541b8be052fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:55Z,use_quota=True,user_id='f74a0c7d95534323b44d0f433c231395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29212397-e729-4305-b320-73e68fc0e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29212397-e729-4305-b320-73e68fc0e83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb8d983-3074-47d0-8802-2a5b6de0541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb8d983-3074-47d0-8802-2a5b6de0541b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb5b3a8-eeab-458f-80ba-af1e02ca922f', 'volume_name': 'volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34745bcd-105d-4c52-8fe5-e9f9096a33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34745bcd-105d-4c52-8fe5-e9f9096a33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d845c40-471b-4a80-a037-61a600580d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Volume 0fb5b3a8-eeab-458f-80ba-af1e02ca922f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f', 'volume_size': 1} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-507849285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb5b3a8-eeab-458f-80ba-af1e02ca922f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e28cfbf841b472596d541b8be052fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:55Z,use_quota=True,user_id='f74a0c7d95534323b44d0f433c231395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Creating volume 0fb5b3a8-eeab-458f-80ba-af1e02ca922f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:54 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:54 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f 1073741824 Jul 03 17:31:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-98ae78d5-0c60-42c5-bcdf-1fb60113bf03 tempest-GroupsTest-524099125 None] Group tempest-Group2-1827330620: creating Jul 03 17:31:54 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-98ae78d5-0c60-42c5-bcdf-1fb60113bf03 tempest-GroupsTest-524099125 None] Group tempest-Group2-1827330620: created successfully Jul 03 17:31:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-98ae78d5-0c60-42c5-bcdf-1fb60113bf03 tempest-GroupsTest-524099125 None] Create group completed successfully. Jul 03 17:31:55 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f 1073741824" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:55 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f Jul 03 17:31:55 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:56 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" returned: 0 in 0.848s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d845c40-471b-4a80-a037-61a600580d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461e38ab-1fb3-47c6-9e0b-55259179826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:56 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Volume volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f (0fb5b3a8-eeab-458f-80ba-af1e02ca922f): created successfully Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461e38ab-1fb3-47c6-9e0b-55259179826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Flow 'volume_create_manager' (d8b0ae77-0d93-48eb-9543-2790740b28ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:56 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-10d2718c-6035-4272-8a44-c3fdeec8c130 tempest-AttachVolumeTestJSON-2098638241 None] Created volume successfully. Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Flow 'volume_create_manager' (12c1415d-86b6-4f5d-9199-f8baaf25bb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43d1348-a6fb-40fa-bd9c-4e6d347221a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43d1348-a6fb-40fa-bd9c-4e6d347221a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1341856128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1defad7f-9020-43f0-9a73-6a5d5b0ebd18,host='devstack@QuobyteHD#QuobyteHD',id=1728f749-ee1e-4551-8b6e-0c2bacc40764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b6d8a176a4e58a7e609a723b0e16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:57Z,use_quota=True,user_id='bd0e7f5e390c44218fc5c14577010f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cd1e871-8a35-49bc-80b1-f8ddfe7fd52a),volume_type_id=8cd1e871-8a35-49bc-80b1-f8ddfe7fd52a)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419548b2-40a2-4d8f-b492-10df54a165e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419548b2-40a2-4d8f-b492-10df54a165e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277ae941-c6fc-4ba3-ab7a-2c54366a0c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277ae941-c6fc-4ba3-ab7a-2c54366a0c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1728f749-ee1e-4551-8b6e-0c2bacc40764', 'volume_name': 'volume-1728f749-ee1e-4551-8b6e-0c2bacc40764', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38de9429-f71e-495d-b6fe-064efe478450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38de9429-f71e-495d-b6fe-064efe478450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4ee030-7441-407a-9bde-9932410d98b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:56 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Volume 1728f749-ee1e-4551-8b6e-0c2bacc40764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1728f749-ee1e-4551-8b6e-0c2bacc40764', 'volume_size': 1} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1defad7f-9020-43f0-9a73-6a5d5b0ebd18,created_at=2026-07-03T15:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1341856128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1defad7f-9020-43f0-9a73-6a5d5b0ebd18,host='devstack@QuobyteHD#QuobyteHD',id=1728f749-ee1e-4551-8b6e-0c2bacc40764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b6d8a176a4e58a7e609a723b0e16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:31:57Z,use_quota=True,user_id='bd0e7f5e390c44218fc5c14577010f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cd1e871-8a35-49bc-80b1-f8ddfe7fd52a),volume_type_id=8cd1e871-8a35-49bc-80b1-f8ddfe7fd52a)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Creating volume 1728f749-ee1e-4551-8b6e-0c2bacc40764 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:31:56 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:31:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:56 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 1073741824 Jul 03 17:31:56 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:57 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 1073741824" returned: 0 in 0.945s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:31:57 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 Jul 03 17:31:57 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:31:58 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764" returned: 0 in 0.835s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4ee030-7441-407a-9bde-9932410d98b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1728f749-ee1e-4551-8b6e-0c2bacc40764', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357eaacd-1c05-47e9-ba68-ad31aaa040d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:31:58 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Volume volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 (1728f749-ee1e-4551-8b6e-0c2bacc40764): created successfully Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357eaacd-1c05-47e9-ba68-ad31aaa040d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:31:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Flow 'volume_create_manager' (12c1415d-86b6-4f5d-9199-f8baaf25bb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:31:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-53382139-a849-45d3-a062-7421449a620b tempest-GroupsTest-524099125 None] Created volume successfully. Jul 03 17:31:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Acquiring lock "cinder-quobyte-1728f749-ee1e-4551-8b6e-0c2bacc40764" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:31:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Lock "cinder-quobyte-1728f749-ee1e-4551-8b6e-0c2bacc40764" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:31:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd518b3-bba5-488d-aabd-d2e94edf730f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:31:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:00 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 Jul 03 17:32:00 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae801da-2171-4e2b-b0b0-422e59d0a8ce]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:00 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f Jul 03 17:32:00 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:01 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764" returned: 0 in 1.119s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:01 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764 Jul 03 17:32:01 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:01 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" returned: 0 in 0.993s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.022s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adfc9865-dae5-4d68-a10a-02adffef5b60', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:32:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-635c1d56-19c6-44e3-95ca-776de2b3567a req-61a63468-3808-46b3-a80f-c654346e08d9 tempest-AttachVolumeTestJSON-2098638241 None] attachment_update completed successfully. Jul 03 17:32:01 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1728f749-ee1e-4551-8b6e-0c2bacc40764" returned: 0 in 0.681s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Lock "cinder-quobyte-1728f749-ee1e-4551-8b6e-0c2bacc40764" released by "delete_volume" :: held 1.887s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Created reservations ['1c815fbb-8f12-481e-884f-c2e3b3a26b7e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:01 devstack cinder-volume[86621]: WARNING cinder.quota [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1508820934 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1508820934, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:32:01 devstack cinder-volume[86621]: WARNING cinder.quota [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1508820934 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1508820934, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:32:01 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Created reservations ['750300e7-c8cb-421a-b698-961c269995aa', '206b7227-1947-464b-bbc4-243c0bf94b84', 'e0aa12a0-2d2d-4ce5-9f74-e148d90ea2c2', '6e17ca69-a3f0-447d-8fe3-b4a39de12e58'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:02 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:02 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Created reservations ['516e73a4-7fee-4d2d-902e-77ddae4202f9'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:02 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:02 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:02 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.705s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:02 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:02 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0e73da89-8cf7-44f0-9e7d-a1fdbd06c852 tempest-GroupsTest-524099125 None] Delete group completed successfully. Jul 03 17:32:03 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.711s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-709b6b02-0f92-49f6-a668-ab8236773770 tempest-GroupsTest-524099125 None] Delete group completed successfully. Jul 03 17:32:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-81130a53-0752-4360-aca7-337c0f5ab094 tempest-GroupsTest-524099125 None] Group tempest-GroupsTest-Group-261930199: creating Jul 03 17:32:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-81130a53-0752-4360-aca7-337c0f5ab094 tempest-GroupsTest-524099125 None] Group tempest-GroupsTest-Group-261930199: created successfully Jul 03 17:32:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-81130a53-0752-4360-aca7-337c0f5ab094 tempest-GroupsTest-524099125 None] Create group completed successfully. Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Flow 'volume_create_manager' (274648b9-7934-457b-bb1f-1a608c23262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45352455-dab0-472d-9d46-4c98043aba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45352455-dab0-472d-9d46-4c98043aba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847022165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28f290d-be37-4f53-a8cc-77398a0ab3b9,host='devstack@QuobyteHD#QuobyteHD',id=6afaa912-3541-474f-a32c-d442321d55d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b6d8a176a4e58a7e609a723b0e16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:06Z,use_quota=True,user_id='bd0e7f5e390c44218fc5c14577010f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91d3ad7c-aeab-4b10-adb1-d02577645f3c),volume_type_id=91d3ad7c-aeab-4b10-adb1-d02577645f3c)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a372342-a48c-4cfd-8c9c-32303f669525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a372342-a48c-4cfd-8c9c-32303f669525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5091fef-11fd-442f-83f9-a964ee58adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5091fef-11fd-442f-83f9-a964ee58adf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afaa912-3541-474f-a32c-d442321d55d5', 'volume_name': 'volume-6afaa912-3541-474f-a32c-d442321d55d5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e6a74f-ecb9-4bc0-9955-24b6f11164f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e6a74f-ecb9-4bc0-9955-24b6f11164f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1877e71d-886d-45ab-a753-c4bc919b1172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:06 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Volume 6afaa912-3541-474f-a32c-d442321d55d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afaa912-3541-474f-a32c-d442321d55d5', 'volume_size': 1} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a28f290d-be37-4f53-a8cc-77398a0ab3b9,created_at=2026-07-03T15:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847022165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28f290d-be37-4f53-a8cc-77398a0ab3b9,host='devstack@QuobyteHD#QuobyteHD',id=6afaa912-3541-474f-a32c-d442321d55d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b6d8a176a4e58a7e609a723b0e16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:06Z,use_quota=True,user_id='bd0e7f5e390c44218fc5c14577010f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91d3ad7c-aeab-4b10-adb1-d02577645f3c),volume_type_id=91d3ad7c-aeab-4b10-adb1-d02577645f3c)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Creating volume 6afaa912-3541-474f-a32c-d442321d55d5 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:06 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:06 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 1073741824 Jul 03 17:32:06 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Flow 'volume_create_manager' (31634382-49c6-4184-bf40-cbfd38f3d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e56234a-d787-4f2c-af11-323a29af856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:08 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e56234a-d787-4f2c-af11-323a29af856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-661835047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cb5763-9abc-473e-b711-7f0f64b8551d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e28cfbf841b472596d541b8be052fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:08Z,use_quota=True,user_id='f74a0c7d95534323b44d0f433c231395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8461d286-ffdc-4da1-a026-190e6cbc8ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8461d286-ffdc-4da1-a026-190e6cbc8ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e637c943-5b02-40c7-9e4e-05a7240a11c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e637c943-5b02-40c7-9e4e-05a7240a11c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cb5763-9abc-473e-b711-7f0f64b8551d', 'volume_name': 'volume-07cb5763-9abc-473e-b711-7f0f64b8551d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509879fb-30bb-4f4c-bc25-217975a6c6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509879fb-30bb-4f4c-bc25-217975a6c6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0bc911-9e49-4b29-84c0-a0a774a71185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:08 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Volume 07cb5763-9abc-473e-b711-7f0f64b8551d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cb5763-9abc-473e-b711-7f0f64b8551d', 'volume_size': 1} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 1073741824" returned: 0 in 1.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:08 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 Jul 03 17:32:08 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:09 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5" returned: 0 in 0.773s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] <== create_volume: return (2693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.707s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-661835047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cb5763-9abc-473e-b711-7f0f64b8551d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e28cfbf841b472596d541b8be052fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:08Z,use_quota=True,user_id='f74a0c7d95534323b44d0f433c231395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Creating volume 07cb5763-9abc-473e-b711-7f0f64b8551d {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:09 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1877e71d-886d-45ab-a753-c4bc919b1172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afaa912-3541-474f-a32c-d442321d55d5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bb78b7-3b45-4677-a338-77be635695d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:09 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d 1073741824 Jul 03 17:32:09 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Volume volume-6afaa912-3541-474f-a32c-d442321d55d5 (6afaa912-3541-474f-a32c-d442321d55d5): created successfully Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bb78b7-3b45-4677-a338-77be635695d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Flow 'volume_create_manager' (274648b9-7934-457b-bb1f-1a608c23262c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-103aa8fa-857b-4596-8da8-a30fa44d23a8 tempest-GroupsTest-524099125 None] Created volume successfully. Jul 03 17:32:11 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d 1073741824" returned: 0 in 1.731s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:11 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d Jul 03 17:32:11 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Flow 'volume_create_manager' (31d11ccf-796c-433f-b54a-9afe4fc2df94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6c11cb-4e6d-4af0-8eb5-b7d82028e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6c11cb-4e6d-4af0-8eb5-b7d82028e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1942874872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28f290d-be37-4f53-a8cc-77398a0ab3b9,host='devstack@QuobyteHD#QuobyteHD',id=62d1aac2-57bd-4bd1-b6dc-95360832e267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b6d8a176a4e58a7e609a723b0e16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:11Z,use_quota=True,user_id='bd0e7f5e390c44218fc5c14577010f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91d3ad7c-aeab-4b10-adb1-d02577645f3c),volume_type_id=91d3ad7c-aeab-4b10-adb1-d02577645f3c)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139816b4-5670-4da5-b19b-e20dc3faae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139816b4-5670-4da5-b19b-e20dc3faae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb10d50-12f8-4a0c-9e24-4f39da8ae7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb10d50-12f8-4a0c-9e24-4f39da8ae7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d1aac2-57bd-4bd1-b6dc-95360832e267', 'volume_name': 'volume-62d1aac2-57bd-4bd1-b6dc-95360832e267', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112c1ce7-4057-42c5-b37a-b28f8708257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112c1ce7-4057-42c5-b37a-b28f8708257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4eae73-6322-4efa-921a-1a5c668bf6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Volume 62d1aac2-57bd-4bd1-b6dc-95360832e267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d1aac2-57bd-4bd1-b6dc-95360832e267', 'volume_size': 1} Jul 03 17:32:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:12 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d" returned: 0 in 1.333s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] <== create_volume: return (3136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.140s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.056s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a28f290d-be37-4f53-a8cc-77398a0ab3b9,created_at=2026-07-03T15:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1942874872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28f290d-be37-4f53-a8cc-77398a0ab3b9,host='devstack@QuobyteHD#QuobyteHD',id=62d1aac2-57bd-4bd1-b6dc-95360832e267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b6d8a176a4e58a7e609a723b0e16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:11Z,use_quota=True,user_id='bd0e7f5e390c44218fc5c14577010f12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91d3ad7c-aeab-4b10-adb1-d02577645f3c),volume_type_id=91d3ad7c-aeab-4b10-adb1-d02577645f3c)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Creating volume 62d1aac2-57bd-4bd1-b6dc-95360832e267 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:12 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0bc911-9e49-4b29-84c0-a0a774a71185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cb5763-9abc-473e-b711-7f0f64b8551d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:12 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 1073741824 Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa83dd27-33ac-4064-bc50-57209bffa34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:12 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:12 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Volume volume-07cb5763-9abc-473e-b711-7f0f64b8551d (07cb5763-9abc-473e-b711-7f0f64b8551d): created successfully Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa83dd27-33ac-4064-bc50-57209bffa34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Flow 'volume_create_manager' (31634382-49c6-4184-bf40-cbfd38f3d10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:12 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0e18923b-e539-4d8e-a321-297175445579 tempest-AttachVolumeTestJSON-2098638241 None] Created volume successfully. Jul 03 17:32:13 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 1073741824" returned: 0 in 1.058s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:13 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:INSERT=23,cinder:SELECT=113,cinder:UPDATE=116,cinder:DELETE=5 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:32:13 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=121,cinder:INSERT=36,cinder:UPDATE=109,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:32:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:13 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 Jul 03 17:32:13 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:14 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267" returned: 0 in 0.775s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4eae73-6322-4efa-921a-1a5c668bf6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d1aac2-57bd-4bd1-b6dc-95360832e267', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d475cd-c2da-4560-b4c1-b675b7d97769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:14 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Volume volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 (62d1aac2-57bd-4bd1-b6dc-95360832e267): created successfully Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d475cd-c2da-4560-b4c1-b675b7d97769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Flow 'volume_create_manager' (31d11ccf-796c-433f-b54a-9afe4fc2df94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:14 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-da9738f3-cfcf-4dbc-9529-f94c86f89a09 tempest-GroupsTest-524099125 None] Created volume successfully. Jul 03 17:32:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-194b4c6a-3073-42a0-90ab-7e373d202268 tempest-GroupsTest-524099125 None] Update group completed successfully. Jul 03 17:32:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c32feae3-04cf-4c41-b385-b5220fdde271 tempest-GroupsTest-524099125 None] Update group completed successfully. Jul 03 17:32:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b515db3b-704a-4249-9014-509a380e514f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:17 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d Jul 03 17:32:17 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:17 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d" returned: 0 in 0.953s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.976s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-07cb5763-9abc-473e-b711-7f0f64b8551d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fa45e95-5f18-40d9-bd98-97fbdf79f422', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:32:17 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-de7edb9d-8f0b-4fae-9117-b9911b7fd3c9 req-787f1e6c-ef88-4b1b-ae74-35ee1c1193c1 tempest-AttachVolumeTestJSON-2098638241 None] attachment_update completed successfully. Jul 03 17:32:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Acquiring lock "cinder-quobyte-62d1aac2-57bd-4bd1-b6dc-95360832e267" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Lock "cinder-quobyte-62d1aac2-57bd-4bd1-b6dc-95360832e267" acquired by "delete_volume" :: waited 0.038s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae0988e-3e98-4764-8419-653e7061401a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:18 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 Jul 03 17:32:18 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:19 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267" returned: 0 in 0.837s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:19 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267 Jul 03 17:32:19 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:20 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-62d1aac2-57bd-4bd1-b6dc-95360832e267" returned: 0 in 0.739s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Lock "cinder-quobyte-62d1aac2-57bd-4bd1-b6dc-95360832e267" released by "delete_volume" :: held 1.654s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Acquiring lock "cinder-quobyte-6afaa912-3541-474f-a32c-d442321d55d5" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Lock "cinder-quobyte-6afaa912-3541-474f-a32c-d442321d55d5" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66c24b8-19bf-44e8-bb0d-caacaeac6ad3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:20 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 Jul 03 17:32:20 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:21 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5" returned: 0 in 0.897s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:21 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5 Jul 03 17:32:21 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:21 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-6afaa912-3541-474f-a32c-d442321d55d5" returned: 0 in 0.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Lock "cinder-quobyte-6afaa912-3541-474f-a32c-d442321d55d5" released by "delete_volume" :: held 1.643s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:21 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Created reservations ['53db8394-457d-43ab-8abf-f9047d2a6a33'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:21 devstack cinder-volume[86621]: WARNING cinder.quota [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2136231959 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2136231959, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:32:21 devstack cinder-volume[86621]: WARNING cinder.quota [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2136231959 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2136231959, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:32:21 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Created reservations ['b783d396-2bc8-49c2-84dc-d0ab20f5e0e2', 'a788ed24-b912-4725-b2ab-dc6706e74c26', '1452ab8a-dd66-4c12-aac5-8728197a6906', '6bbc9be4-407f-44b3-ae53-132e894cdd09'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Created reservations ['8b378719-add4-4949-9e5b-39e5e5e02168', '86312ae4-7886-4f4f-86b2-065d4123c95d', 'fe279195-36c4-4b56-a39f-9d2b5316b436', 'f78f86b3-f3dc-43ac-84ab-3ee41dbb06a3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:22 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:22 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Acquiring lock "cinder-41ec133a-ec15-43ee-9de3-1e308d3da9b2-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Lock "cinder-41ec133a-ec15-43ee-9de3-1e308d3da9b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Acquiring lock "cinder-quobyte-41ec133a-ec15-43ee-9de3-1e308d3da9b2" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:22 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.723s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Lock "cinder-quobyte-41ec133a-ec15-43ee-9de3-1e308d3da9b2" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b5f92616-715a-4c6d-8646-872e2530dd33 tempest-GroupsTest-524099125 None] Delete group completed successfully. Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5695552-eaf3-4574-9617-5acc39e5321b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:23 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 Jul 03 17:32:23 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:23 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2" returned: 0 in 0.823s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:23 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2 Jul 03 17:32:23 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:24 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41ec133a-ec15-43ee-9de3-1e308d3da9b2" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Lock "cinder-quobyte-41ec133a-ec15-43ee-9de3-1e308d3da9b2" released by "delete_volume" :: held 1.518s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Created reservations ['6556c556-3fcc-43c7-bd6c-f576d0b70359', '2de0646a-3f80-48a1-8b43-946d88acc412', 'e7b9de08-3eba-4894-a10a-a385a1a1b722', 'abd204bd-4e00-4c1c-9b33-76ae6a955a7c'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:24 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:24 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-f62e0c31-9cc1-4bc8-be5e-92505099fc83 req-e2c943b3-3bfa-4daf-8fbd-a42f4a9af6ea tempest-AttachVolumeTestJSON-2098638241 None] Terminate volume connection completed successfully. Jul 03 17:32:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-f62e0c31-9cc1-4bc8-be5e-92505099fc83 req-e2c943b3-3bfa-4daf-8fbd-a42f4a9af6ea tempest-AttachVolumeTestJSON-2098638241 None] Deleting attachment adfc9865-dae5-4d68-a10a-02adffef5b60. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:32:25 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.769s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:25 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Deleted volume successfully. Jul 03 17:32:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d736368b-bf87-410e-89dd-2e0e173afc9a tempest-VolumesNegativeTest-132242985 None] Lock "cinder-41ec133a-ec15-43ee-9de3-1e308d3da9b2-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-218ba8c6-e44d-478d-8990-413886d0b6c6 req-72df8213-c76a-480f-97dc-4788297ca896 tempest-AttachVolumeTestJSON-2098638241 None] Terminate volume connection completed successfully. Jul 03 17:32:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-218ba8c6-e44d-478d-8990-413886d0b6c6 req-72df8213-c76a-480f-97dc-4788297ca896 tempest-AttachVolumeTestJSON-2098638241 None] Deleting attachment 6fa45e95-5f18-40d9-bd98-97fbdf79f422. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Flow 'volume_create_manager' (f3adc1ce-3fb0-4dbc-a245-aff12b6819c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fcb263-2a16-491f-8128-4e1d9f68de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fcb263-2a16-491f-8128-4e1d9f68de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-235192818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94515c02-f744-4860-941f-b4e9a196663b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a477e7bca864d1381dc18452bd4290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:29Z,use_quota=True,user_id='983d63cab3174c6b9fcf9147777443bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a2f719-bbd0-45c9-823c-af7e579cb7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a2f719-bbd0-45c9-823c-af7e579cb7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62febd84-63ca-40db-943f-f0a92f609bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62febd84-63ca-40db-943f-f0a92f609bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94515c02-f744-4860-941f-b4e9a196663b', 'volume_name': 'volume-94515c02-f744-4860-941f-b4e9a196663b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cd08a7-f8a8-4915-b1ff-5841e0b21fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cd08a7-f8a8-4915-b1ff-5841e0b21fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33daded4-cdf4-40f3-8013-27a47680c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:29 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Volume 94515c02-f744-4860-941f-b4e9a196663b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94515c02-f744-4860-941f-b4e9a196663b', 'volume_size': 1} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-235192818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94515c02-f744-4860-941f-b4e9a196663b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a477e7bca864d1381dc18452bd4290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:29Z,use_quota=True,user_id='983d63cab3174c6b9fcf9147777443bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Creating volume 94515c02-f744-4860-941f-b4e9a196663b {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:29 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:29 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b 1073741824 Jul 03 17:32:29 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:30 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b 1073741824" returned: 0 in 1.077s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:30 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b Jul 03 17:32:30 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:31 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b" returned: 0 in 0.809s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33daded4-cdf4-40f3-8013-27a47680c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94515c02-f744-4860-941f-b4e9a196663b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8fd715-a728-4766-8c15-86c25e64979b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Volume volume-94515c02-f744-4860-941f-b4e9a196663b (94515c02-f744-4860-941f-b4e9a196663b): created successfully Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8fd715-a728-4766-8c15-86c25e64979b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Flow 'volume_create_manager' (f3adc1ce-3fb0-4dbc-a245-aff12b6819c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-824593c5-5b37-4759-955c-f827135dcb26 tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Created volume successfully. Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Acquiring lock "cinder-94515c02-f744-4860-941f-b4e9a196663b-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "cinder-94515c02-f744-4860-941f-b4e9a196663b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Acquiring lock "cinder-quobyte-94515c02-f744-4860-941f-b4e9a196663b" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "cinder-quobyte-94515c02-f744-4860-941f-b4e9a196663b" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Flow 'volume_create_manager' (906d94ae-c4b6-43f6-b207-c75b2da0b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70bccbe-8d1f-4545-a760-79cbc57109f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc3972-ca4d-4b1b-8cee-c2365c711468]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70bccbe-8d1f-4545-a760-79cbc57109f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-103639712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2df4b06-6a4b-48aa-a54a-e330e50d2be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438abfdbed64fee9c8f053f14d02747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:34Z,use_quota=True,user_id='195c65867a6b47ef924a3ad4e190ee54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965f189-efa8-4f09-961c-6910ba2e83c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965f189-efa8-4f09-961c-6910ba2e83c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b502726-1f9b-40d1-b5f6-0c6b991f0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b502726-1f9b-40d1-b5f6-0c6b991f0988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2df4b06-6a4b-48aa-a54a-e330e50d2be6', 'volume_name': 'volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7373b7e7-7e8a-48cf-99a7-98552d67c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7373b7e7-7e8a-48cf-99a7-98552d67c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db47d9bb-e9f9-4ea8-8c07-4a4ef7043f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Volume d2df4b06-6a4b-48aa-a54a-e330e50d2be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6', 'volume_size': 1} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-103639712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2df4b06-6a4b-48aa-a54a-e330e50d2be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0438abfdbed64fee9c8f053f14d02747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:34Z,use_quota=True,user_id='195c65867a6b47ef924a3ad4e190ee54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Creating volume d2df4b06-6a4b-48aa-a54a-e330e50d2be6 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:34 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:34 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b Jul 03 17:32:34 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:34 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 1073741824 Jul 03 17:32:34 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:35 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b" returned: 0 in 1.031s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:35 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b Jul 03 17:32:35 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:35 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 1073741824" returned: 0 in 1.128s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:35 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 Jul 03 17:32:35 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:36 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94515c02-f744-4860-941f-b4e9a196663b" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "cinder-quobyte-94515c02-f744-4860-941f-b4e9a196663b" released by "delete_volume" :: held 1.928s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Created reservations ['03356d9a-781c-4354-bcc5-72da49dc6c8a', '6385a128-fbd4-428d-aeb9-e2bfdc79cf4b', '1b3502fe-6a6e-4bc1-b016-5e163679acca', '0c4fac18-4e48-4678-94b9-ef5841b58048'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:36 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:36 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:36 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" returned: 0 in 1.128s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db47d9bb-e9f9-4ea8-8c07-4a4ef7043f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74cfe95-7256-4e70-8476-8b0c49373ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Volume volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 (d2df4b06-6a4b-48aa-a54a-e330e50d2be6): created successfully Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74cfe95-7256-4e70-8476-8b0c49373ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Flow 'volume_create_manager' (906d94ae-c4b6-43f6-b207-c75b2da0b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-60e232b9-c8b1-475c-9a21-dc04821c42b8 tempest-AttachVolumeNegativeTest-20524444 None] Created volume successfully. Jul 03 17:32:37 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.856s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:37 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Deleted volume successfully. Jul 03 17:32:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-98cc5842-e491-4689-b300-dbc0830ffeae tempest-VolumeQuotasNegativeTestJSON-1416048422 None] Lock "cinder-94515c02-f744-4860-941f-b4e9a196663b-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "cinder-07cb5763-9abc-473e-b711-7f0f64b8551d-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-07cb5763-9abc-473e-b711-7f0f64b8551d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "cinder-quobyte-07cb5763-9abc-473e-b711-7f0f64b8551d" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-quobyte-07cb5763-9abc-473e-b711-7f0f64b8551d" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acffa66-48f8-49e6-bbf5-f1d76e406a23]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:39 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d Jul 03 17:32:39 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (0dbeb341-03a2-4098-9525-f8e5dc5c2a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5c3bf5-0b53-4b7e-9774-a9d1f87735bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5c3bf5-0b53-4b7e-9774-a9d1f87735bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1591947427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01337e08-cd88-4cb6-953a-5615752e1379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:40Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb1c0b-89fe-496d-99aa-0e1b60e6afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb1c0b-89fe-496d-99aa-0e1b60e6afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6c7905-2855-4dfb-b3de-00ed0805786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6c7905-2855-4dfb-b3de-00ed0805786c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01337e08-cd88-4cb6-953a-5615752e1379', 'volume_name': 'volume-01337e08-cd88-4cb6-953a-5615752e1379', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31793b62-95bd-4389-bd61-b43d4d41e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31793b62-95bd-4389-bd61-b43d4d41e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88edd74f-acd5-4a16-8cd9-12be5dd05fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Volume 01337e08-cd88-4cb6-953a-5615752e1379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01337e08-cd88-4cb6-953a-5615752e1379', 'volume_size': 1} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1591947427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01337e08-cd88-4cb6-953a-5615752e1379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:40Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Creating volume 01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:40 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:40 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 1073741824 Jul 03 17:32:40 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:40 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d" returned: 0 in 0.926s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:40 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d Jul 03 17:32:40 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:41 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-07cb5763-9abc-473e-b711-7f0f64b8551d" returned: 0 in 0.705s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:41 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 1073741824" returned: 0 in 0.998s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-quobyte-07cb5763-9abc-473e-b711-7f0f64b8551d" released by "delete_volume" :: held 1.689s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:41 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 Jul 03 17:32:41 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Created reservations ['c33387f8-24ee-4608-be9c-4bac88d99eae', '8d3365a9-84de-442a-8045-641df81f7b94', '62e26845-d618-426b-ada1-cda1b66c290b', '348b12f9-c504-4ed2-a805-93464e649ae2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:41 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:41 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "cinder-0fb5b3a8-eeab-458f-80ba-af1e02ca922f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-0fb5b3a8-eeab-458f-80ba-af1e02ca922f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "cinder-quobyte-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-quobyte-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" acquired by "delete_volume" :: waited 0.040s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cadcd00-62ec-4030-9cd6-1c4cb00a31df]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:41 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379" returned: 0 in 0.711s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.435s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88edd74f-acd5-4a16-8cd9-12be5dd05fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01337e08-cd88-4cb6-953a-5615752e1379', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8840f5a6-e6d3-4d70-bee1-eba1db5358b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[931cd0af-de6b-48d7-9a35-5574443d7e2b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:41 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f Jul 03 17:32:41 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:42 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Volume volume-01337e08-cd88-4cb6-953a-5615752e1379 (01337e08-cd88-4cb6-953a-5615752e1379): created successfully Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8840f5a6-e6d3-4d70-bee1-eba1db5358b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (0dbeb341-03a2-4098-9525-f8e5dc5c2a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f4142856-316b-416e-93e2-4a24c79ddd5c tempest-VolumesSnapshotTestJSON-1503055265 None] Created volume successfully. Jul 03 17:32:42 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 Jul 03 17:32:42 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:42 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Deleted volume successfully. Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-27df807a-d913-4ea0-a9ab-101339d56661 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-07cb5763-9abc-473e-b711-7f0f64b8551d-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:42 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" returned: 0 in 1.001s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:42 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" returned: 0 in 0.867s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:42 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f Jul 03 17:32:42 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating offline snapshot b5d61dc4-d414-401a-a7fc-bc5a9300631c of volume 01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced84f83-9917-4f79-910c-9f45a96a1638]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b7e6675-ada8-401f-a767-25f14fd35773', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:32:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-7d15fbc5-5eb0-45fe-acfa-05c1df41bf42 req-a663f4ba-c5d2-4bb4-981d-b212a5edbe44 tempest-AttachVolumeNegativeTest-20524444 None] attachment_update completed successfully. Jul 03 17:32:43 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 Jul 03 17:32:43 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:43 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" returned: 0 in 0.715s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-quobyte-0fb5b3a8-eeab-458f-80ba-af1e02ca922f" released by "delete_volume" :: held 1.773s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Flow 'volume_create_manager' (b8a791b4-ab5b-46e4-b71f-050b5a3f87fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f3373d-e033-4034-9887-b0e0e9ff1696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f3373d-e033-4034-9887-b0e0e9ff1696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-600722030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072ce46c-65d4-4a13-b5d4-5cf664529929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83433b190d74db0817e6820cb7989e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:44Z,use_quota=True,user_id='95d54703440a4137981145896c3b5755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7165f70-0057-4a00-8159-8da3e6387736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7165f70-0057-4a00-8159-8da3e6387736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc501a81-8dcc-477c-a7c7-ee692694a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc501a81-8dcc-477c-a7c7-ee692694a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072ce46c-65d4-4a13-b5d4-5cf664529929', 'volume_name': 'volume-072ce46c-65d4-4a13-b5d4-5cf664529929', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e096f4b-1d0e-4211-88ae-aa9ba591544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e096f4b-1d0e-4211-88ae-aa9ba591544d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb38c7e-91cd-490f-b5e5-ecd1ac6f61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:43 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Volume 072ce46c-65d4-4a13-b5d4-5cf664529929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072ce46c-65d4-4a13-b5d4-5cf664529929', 'volume_size': 1} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:43 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379" returned: 0 in 0.879s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:43 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:43 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Created reservations ['5eaa2f7b-41fe-494c-9036-acc3172a9120', 'ff96c6bd-ec01-4f32-8581-a2613d4b5be8', 'bcf215b6-84c6-43c5-ab6a-178ab465952e', '65cb3566-9637-4e5d-9344-2d52d3895372'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:43 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c 1G Jul 03 17:32:43 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:43 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:43 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "cinder-23fda25f-85d9-4e75-99b1-9639916497a2-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-23fda25f-85d9-4e75-99b1-9639916497a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "cinder-quobyte-23fda25f-85d9-4e75-99b1-9639916497a2" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-quobyte-23fda25f-85d9-4e75-99b1-9639916497a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a76d26-ed59-4368-bc12-aeab8d8bdc80]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:44 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 Jul 03 17:32:44 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:44 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.725s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:32:44 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c 1G" returned: 0 in 0.948s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01337e08-cd88-4cb6-953a-5615752e1379 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:44 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01337e08-cd88-4cb6-953a-5615752e1379 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c Jul 03 17:32:44 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:44 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.962s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Deleted volume successfully. Jul 03 17:32:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-30ac937d-1bbd-492b-aafa-313f5eda47d4 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-0fb5b3a8-eeab-458f-80ba-af1e02ca922f-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:45 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2" returned: 0 in 0.838s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:45 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2 Jul 03 17:32:45 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:45 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01337e08-cd88-4cb6-953a-5615752e1379 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c" returned: 0 in 0.753s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:45 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c is being set with open permissions: ugo+rw Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:45 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c Jul 03 17:32:45 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:45 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-23fda25f-85d9-4e75-99b1-9639916497a2" returned: 0 in 0.693s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-quobyte-23fda25f-85d9-4e75-99b1-9639916497a2" released by "delete_volume" :: held 1.577s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Created reservations ['9f1bd0ed-ff06-431c-aace-bda67442a866', 'b7ba85f4-1b2f-44e7-8877-c258c7976987', '114dd2ef-9cc8-4435-9b4d-519e48c60d3b', '2f8a45ce-2391-451a-9c47-83b82b7edb2e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:45 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:32:45 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:46 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c" returned: 0 in 0.644s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:46 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info Jul 03 17:32:46 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:46 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.684s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:32:46 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Deleted volume successfully. Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3e1909e-bb5e-4b02-a30a-2ce31838dbd9 tempest-AttachVolumeTestJSON-2098638241 None] Lock "cinder-23fda25f-85d9-4e75-99b1-9639916497a2-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:46 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info" returned: 0 in 0.728s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:46 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info is being set with open permissions: ugo+rw Jul 03 17:32:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:46 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info Jul 03 17:32:46 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:47 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.info" returned: 0 in 0.684s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.742s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.863s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-600722030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072ce46c-65d4-4a13-b5d4-5cf664529929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83433b190d74db0817e6820cb7989e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:44Z,use_quota=True,user_id='95d54703440a4137981145896c3b5755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Creating volume 072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:47 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:47 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 1073741824 Jul 03 17:32:47 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f9580d08-3b7b-41c1-b40d-954fb4c414c5 tempest-VolumesSnapshotTestJSON-1503055265 None] Create snapshot completed successfully Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-b5d61dc4-d414-401a-a7fc-bc5a9300631c-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-b5d61dc4-d414-401a-a7fc-bc5a9300631c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-01337e08-cd88-4cb6-953a-5615752e1379" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-01337e08-cd88-4cb6-953a-5615752e1379" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-b5d61dc4-d414-401a-a7fc-bc5a9300631c" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-b5d61dc4-d414-401a-a7fc-bc5a9300631c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Deleting offline snapshot b5d61dc4-d414-401a-a7fc-bc5a9300631c of volume 01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] snapshot_file for this snap is: volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c320bad-e17a-4f8d-a154-b70249f12ce0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:48 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c Jul 03 17:32:48 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:48 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 1073741824" returned: 0 in 1.119s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:48 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 Jul 03 17:32:48 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:49 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c" returned: 0 in 0.983s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01337e08-cd88-4cb6-953a-5615752e1379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e8527-c713-4f16-8338-29e62d048256]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:49 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 Jul 03 17:32:49 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:49 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929" returned: 0 in 0.980s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb38c7e-91cd-490f-b5e5-ecd1ac6f61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072ce46c-65d4-4a13-b5d4-5cf664529929', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77385d72-99eb-4d0f-85eb-17abe4596206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:49 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Volume volume-072ce46c-65d4-4a13-b5d4-5cf664529929 (072ce46c-65d4-4a13-b5d4-5cf664529929): created successfully Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77385d72-99eb-4d0f-85eb-17abe4596206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Flow 'volume_create_manager' (b8a791b4-ab5b-46e4-b71f-050b5a3f87fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1a019d0b-6692-4e36-bff8-2855f6e1b646 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Created volume successfully. Jul 03 17:32:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-6565c140-19a5-40e8-b1b1-49729e7483b1 req-850cf816-6956-4bbd-957f-7030ff4f1c0f tempest-AttachVolumeNegativeTest-20524444 None] Terminate volume connection completed successfully. Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-6565c140-19a5-40e8-b1b1-49729e7483b1 req-850cf816-6956-4bbd-957f-7030ff4f1c0f tempest-AttachVolumeNegativeTest-20524444 None] Deleting attachment 4b7e6675-ada8-401f-a767-25f14fd35773. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Creating offline snapshot ac00d94a-27bb-41d5-8bc3-0e41f252b71d of volume 072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250f7a1-0cfc-4400-af8b-b3fd95557701]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:50 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379" returned: 0 in 1.119s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:50 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c Jul 03 17:32:50 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:50 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 Jul 03 17:32:50 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:51 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c" returned: 0 in 0.912s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:51 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c Jul 03 17:32:51 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:51 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929" returned: 0 in 1.030s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:51 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d 1G Jul 03 17:32:51 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:52 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379.b5d61dc4-d414-401a-a7fc-bc5a9300631c" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-b5d61dc4-d414-401a-a7fc-bc5a9300631c" released by "_delete_snapshot" :: held 4.096s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-01337e08-cd88-4cb6-953a-5615752e1379" released by "delete_snapshot" :: held 4.125s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:52 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d 1G" returned: 0 in 0.959s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072ce46c-65d4-4a13-b5d4-5cf664529929 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['c35762ec-6ca8-47e0-af8b-bed6f171adcd', '93e8c598-dce1-46a7-a618-1b2d7eb4c1f4', '39395169-2e7d-4075-b27e-904dd54cf0f7', '6f053a5d-53b6-44d9-8ae8-87e4bc213ea1'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:32:52 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072ce46c-65d4-4a13-b5d4-5cf664529929 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d Jul 03 17:32:52 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Delete snapshot completed successfully. Jul 03 17:32:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec00086c-ac94-4dac-b604-f9c313c1d7b7 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-b5d61dc4-d414-401a-a7fc-bc5a9300631c-delete_snapshot" released by "delete_snapshot" :: held 4.378s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:32:53 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-072ce46c-65d4-4a13-b5d4-5cf664529929 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d" returned: 0 in 0.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:53 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d is being set with open permissions: ugo+rw Jul 03 17:32:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:53 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d Jul 03 17:32:53 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:54 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d" returned: 0 in 1.006s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:54 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info Jul 03 17:32:54 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (94672398-1e37-45ed-93e2-c70478a16e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0876dd4c-2ead-4336-b01a-d922a18ae7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0876dd4c-2ead-4336-b01a-d922a18ae7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538563067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49179bde-89df-40d9-841c-cb70c270e4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:54Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460d6b50-ffa2-4655-a260-73be5c5dc12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460d6b50-ffa2-4655-a260-73be5c5dc12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572d1343-27a5-4166-b2d2-df5d1520d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572d1343-27a5-4166-b2d2-df5d1520d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49179bde-89df-40d9-841c-cb70c270e4a9', 'volume_name': 'volume-49179bde-89df-40d9-841c-cb70c270e4a9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afbc36c-b673-48e4-86c7-5dd2a08bc4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afbc36c-b673-48e4-86c7-5dd2a08bc4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad6659-b242-4682-a92a-2cb0e135f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume 49179bde-89df-40d9-841c-cb70c270e4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49179bde-89df-40d9-841c-cb70c270e4a9', 'volume_size': 1} Jul 03 17:32:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:55 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:55 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info is being set with open permissions: ugo+rw Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:55 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info Jul 03 17:32:55 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:55 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.info" returned: 0 in 0.749s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.388s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538563067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49179bde-89df-40d9-841c-cb70c270e4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:32:54Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating volume 49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:32:55 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:32:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:55 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 1073741824 Jul 03 17:32:55 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:55 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d2b735aa-7f59-4da4-991a-d9d4a1c8281c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Create snapshot completed successfully Jul 03 17:32:56 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 1073741824" returned: 0 in 0.880s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:56 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:32:56 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "cinder-ac00d94a-27bb-41d5-8bc3-0e41f252b71d-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-ac00d94a-27bb-41d5-8bc3-0e41f252b71d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "cinder-quobyte-072ce46c-65d4-4a13-b5d4-5cf664529929" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-quobyte-072ce46c-65d4-4a13-b5d4-5cf664529929" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "cinder-quobyte-ac00d94a-27bb-41d5-8bc3-0e41f252b71d" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-quobyte-ac00d94a-27bb-41d5-8bc3-0e41f252b71d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Deleting offline snapshot ac00d94a-27bb-41d5-8bc3-0e41f252b71d of volume 072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] snapshot_file for this snap is: volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a0aac-bca5-4242-b98d-76936c0d670f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:57 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d Jul 03 17:32:57 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:57 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 0.760s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad6659-b242-4682-a92a-2cb0e135f49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49179bde-89df-40d9-841c-cb70c270e4a9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1556e30d-6439-4873-88a4-0aff8ddea559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:32:57 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume volume-49179bde-89df-40d9-841c-cb70c270e4a9 (49179bde-89df-40d9-841c-cb70c270e4a9): created successfully Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1556e30d-6439-4873-88a4-0aff8ddea559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (94672398-1e37-45ed-93e2-c70478a16e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:32:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ba2d0fe6-a111-477d-8310-8025f9f81005 tempest-VolumesSnapshotTestJSON-1503055265 None] Created volume successfully. Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating offline snapshot 9e453753-1e8b-43fb-a7b5-81013b8c7729 of volume 49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb98a3-57e4-4de3-a749-cbdb03acc745]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:58 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:32:58 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:58 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d" returned: 0 in 0.830s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-072ce46c-65d4-4a13-b5d4-5cf664529929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:32:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5faf8cf-db9c-4552-a80f-8805a9014be2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:32:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:58 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 Jul 03 17:32:58 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:58 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 0.831s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:58 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 1G Jul 03 17:32:58 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:59 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929" returned: 0 in 0.796s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:59 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d Jul 03 17:32:59 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7bb75ca4-9537-4439-bce6-7d2339c182da tempest-BackendsCapabilitiesAdminTestsJSON-709172165 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7351341247559, 'free_capacity_gb': 1775.7351341247559, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86621) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 17:32:59 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 1G" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49179bde-89df-40d9-841c-cb70c270e4a9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:59 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49179bde-89df-40d9-841c-cb70c270e4a9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 Jul 03 17:32:59 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:59 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d" returned: 0 in 0.872s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:32:59 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d Jul 03 17:32:59 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:32:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d8bdb3c0-e237-468b-a6cf-66b496ec3bb9 tempest-BackendsCapabilitiesAdminTestsJSON-709172165 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7351341247559, 'free_capacity_gb': 1775.7351341247559, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86621) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "cinder-d2df4b06-6a4b-48aa-a54a-e330e50d2be6-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:00 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-d2df4b06-6a4b-48aa-a54a-e330e50d2be6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49179bde-89df-40d9-841c-cb70c270e4a9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729" returned: 0 in 0.850s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:00 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 is being set with open permissions: ugo+rw Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:00 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 Jul 03 17:33:00 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "cinder-quobyte-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-quobyte-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976152c-064a-4ef7-9ce0-6afde933e2a9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:00 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929.ac00d94a-27bb-41d5-8bc3-0e41f252b71d" returned: 0 in 0.774s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-quobyte-ac00d94a-27bb-41d5-8bc3-0e41f252b71d" released by "_delete_snapshot" :: held 3.412s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-quobyte-072ce46c-65d4-4a13-b5d4-5cf664529929" released by "delete_snapshot" :: held 3.442s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:00 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 Jul 03 17:33:00 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Created reservations ['9371fb70-c9f8-4cfe-8a0f-1216b660defb', 'aa5b4dba-9cfa-4ddf-ab19-60614e18ec24', 'e1699a26-ebd9-45c2-9155-aca88b26772e', '3e946925-7d71-4975-bcd1-6b97227d37fd'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Delete snapshot completed successfully. Jul 03 17:33:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0a6ef34-3a9c-44ca-ad3a-e3112419f9d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-ac00d94a-27bb-41d5-8bc3-0e41f252b71d-delete_snapshot" released by "delete_snapshot" :: held 3.625s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729" returned: 0 in 0.731s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:01 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:01 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info Jul 03 17:33:01 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:01 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" returned: 0 in 0.908s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:01 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6 Jul 03 17:33:01 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "cinder-072ce46c-65d4-4a13-b5d4-5cf664529929-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-072ce46c-65d4-4a13-b5d4-5cf664529929-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "cinder-quobyte-072ce46c-65d4-4a13-b5d4-5cf664529929" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-quobyte-072ce46c-65d4-4a13-b5d4-5cf664529929" acquired by "delete_volume" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c78451-37b0-43df-b06c-bbccee381ea2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:02 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 Jul 03 17:33:02 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:02 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info" returned: 0 in 0.856s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:02 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info is being set with open permissions: ugo+rw Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:02 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info Jul 03 17:33:02 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:02 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-quobyte-d2df4b06-6a4b-48aa-a54a-e330e50d2be6" released by "delete_volume" :: held 1.883s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Created reservations ['b788e630-2829-45e7-b96a-f8706eb2d7af', '19693c9d-e2c4-4904-9b1d-0e8b27737145', 'da7046ec-a8cd-4b4a-a5c7-b03b92df3e13', 'a88f4570-bdc8-4c3a-b1ed-aaf98cd9d9fc'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:02 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:02 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:03 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929" returned: 0 in 1.062s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:03 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "cinder-e5905800-dfa8-43db-9263-730c872a47ac-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.info" returned: 0 in 0.923s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:03 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929 Jul 03 17:33:03 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.256s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-e5905800-dfa8-43db-9263-730c872a47ac-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-52f3511d-6d74-43b2-8c67-0cbf097aa3d9 tempest-VolumesSnapshotTestJSON-1503055265 None] Create snapshot completed successfully Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "cinder-quobyte-e5905800-dfa8-43db-9263-730c872a47ac" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-quobyte-e5905800-dfa8-43db-9263-730c872a47ac" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d8c0b-993f-4c5f-9e60-c6bce8ed4f35]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:03 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac Jul 03 17:33:03 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:03 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.010s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Deleted volume successfully. Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25139793-2e2b-40c0-bda0-a31ac449cb85 tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-d2df4b06-6a4b-48aa-a54a-e330e50d2be6-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:03 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-072ce46c-65d4-4a13-b5d4-5cf664529929" returned: 0 in 0.794s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-quobyte-072ce46c-65d4-4a13-b5d4-5cf664529929" released by "delete_volume" :: held 1.949s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Created reservations ['a284ca17-22f5-4200-8205-38a65d261ce1', 'a6a5872e-8300-41a0-9020-c83e8cf2eded', '1f59362c-63a6-4a5b-9dc1-bb23a0df7e57', '4bbc8c44-e843-40b9-b8ad-cdd58ef2c9d8'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:04 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:04 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:04 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac" returned: 0 in 0.939s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:04 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac Jul 03 17:33:04 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:04 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.791s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Deleted volume successfully. Jul 03 17:33:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a20cb48f-7c56-4eb5-b866-e12a27fd444c tempest-VolumeSnapshotQuotasNegativeTestJSON-1475049068 None] Lock "cinder-072ce46c-65d4-4a13-b5d4-5cf664529929-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (6119ce27-4329-4c7d-a2f1-f4e72fccdaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affd8137-e071-4b45-9f9f-008e504c351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affd8137-e071-4b45-9f9f-008e504c351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037041553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a8886e-876d-48c7-b703-60bcf9efe4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9e453753-1e8b-43fb-a7b5-81013b8c7729,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:05Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0498283-e827-4ceb-922a-029fafaed6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0498283-e827-4ceb-922a-029fafaed6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d185b3f-b353-4198-ae9a-b55f4f7ef5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d185b3f-b353-4198-ae9a-b55f4f7ef5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32a8886e-876d-48c7-b703-60bcf9efe4c3', 'volume_name': 'volume-32a8886e-876d-48c7-b703-60bcf9efe4c3', 'volume_size': 2, 'snapshot_id': '9e453753-1e8b-43fb-a7b5-81013b8c7729'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664cee0c-9970-4e5a-a315-f522d04938ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664cee0c-9970-4e5a-a315-f522d04938ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a3fda1-eea4-420a-8436-a2d41ea0dc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Volume 32a8886e-876d-48c7-b703-60bcf9efe4c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32a8886e-876d-48c7-b703-60bcf9efe4c3', 'volume_size': 2, 'snapshot_id': '9e453753-1e8b-43fb-a7b5-81013b8c7729'} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-9e453753-1e8b-43fb-a7b5-81013b8c7729-32a8886e-876d-48c7-b703-60bcf9efe4c3" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-9e453753-1e8b-43fb-a7b5-81013b8c7729-32a8886e-876d-48c7-b703-60bcf9efe4c3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Creating volume 32a8886e-876d-48c7-b703-60bcf9efe4c3 from snapshot 9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-32a8886e-876d-48c7-b703-60bcf9efe4c3" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-32a8886e-876d-48c7-b703-60bcf9efe4c3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] snapshot: 9e453753-1e8b-43fb-a7b5-81013b8c7729, volume: 32a8886e-876d-48c7-b703-60bcf9efe4c3, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:33:05 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e5905800-dfa8-43db-9263-730c872a47ac" returned: 0 in 1.053s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e8b68b-1734-49ee-84c7-c4e8b61431b7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-quobyte-e5905800-dfa8-43db-9263-730c872a47ac" released by "delete_volume" :: held 2.040s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Created reservations ['6edb4970-397f-4bf8-a0b1-be49aebbef36', '8eb58be0-0fad-45f6-9283-27abfb13013f', 'dda35953-0cb4-4bb6-be5f-b01d7aec4b81', '74072aa1-8f5f-4738-b7d1-eb8ce9784824'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:05 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 Jul 03 17:33:05 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:05 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:05 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "cinder-12702dab-cf08-46d3-a8f2-7d989a82442a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-12702dab-cf08-46d3-a8f2-7d989a82442a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "cinder-quobyte-12702dab-cf08-46d3-a8f2-7d989a82442a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-quobyte-12702dab-cf08-46d3-a8f2-7d989a82442a" acquired by "delete_volume" :: waited 0.037s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c9bca1-2345-4520-bdc1-f9ab8291681d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:06 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729" returned: 0 in 1.002s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49179bde-89df-40d9-841c-cb70c270e4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39896373-4849-42cc-9206-cea590563b35]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:06 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a Jul 03 17:33:06 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:06 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:33:06 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:06 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.009s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Deleted volume successfully. Jul 03 17:33:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24a1bf2e-c253-4cad-8168-d5c24947d38e tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-e5905800-dfa8-43db-9263-730c872a47ac-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:07 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a" returned: 0 in 1.081s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:07 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 0.953s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:07 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a Jul 03 17:33:07 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:33:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:07 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:07 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 Jul 03 17:33:07 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:08 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12702dab-cf08-46d3-a8f2-7d989a82442a" returned: 0 in 0.824s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-quobyte-12702dab-cf08-46d3-a8f2-7d989a82442a" released by "delete_volume" :: held 1.961s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Created reservations ['9e397f46-11cb-49e6-94c5-7ef1cacb05bf', '8d868ecd-4190-4408-9136-2015017a8c4d', 'a3a2c515-9372-4eee-a12f-75fdf88ff585', '08d76202-b27c-443f-bab3-bee8f7418487'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:08 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:08 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:10 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.814s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:10 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Deleted volume successfully. Jul 03 17:33:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40199d39-e409-47b1-ade8-3cb820edbd9c tempest-AttachVolumeNegativeTest-20524444 None] Lock "cinder-12702dab-cf08-46d3-a8f2-7d989a82442a-delete_volume" released by "delete_volume" :: held 4.160s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:14 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3" returned: 0 in 6.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:14 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e65497-6199-4d69-92ab-0823c8886834]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:14 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:33:14 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:15 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 1.091s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:15 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:33:15 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Converted 1024.00 MB image at 151.80 MB/s Jul 03 17:33:15 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 is being set with open permissions: ugo+rw Jul 03 17:33:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:15 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 Jul 03 17:33:15 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:16 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3" returned: 0 in 0.960s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-32a8886e-876d-48c7-b703-60bcf9efe4c3" released by "_copy_volume_from_snapshot" :: held 10.913s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-9e453753-1e8b-43fb-a7b5-81013b8c7729-32a8886e-876d-48c7-b703-60bcf9efe4c3" released by "_create_volume_from_snapshot" :: held 10.955s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.977s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=132,cinder:SELECT=116,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=119,cinder:INSERT=25,cinder:UPDATE=127,cinder:DELETE=9 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a3fda1-eea4-420a-8436-a2d41ea0dc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a8886e-876d-48c7-b703-60bcf9efe4c3', 'volume_size': 2, 'snapshot_id': '9e453753-1e8b-43fb-a7b5-81013b8c7729'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38541ca-454c-4ebc-875c-f7a3760a6d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Flow 'volume_create_manager' (1bdfe247-2852-4317-bd0c-666a5d86d5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5380ba0d-ea00-4aaa-95cd-b3d3cc9650c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Volume volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 (32a8886e-876d-48c7-b703-60bcf9efe4c3): created successfully Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38541ca-454c-4ebc-875c-f7a3760a6d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (6119ce27-4329-4c7d-a2f1-f4e72fccdaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5380ba0d-ea00-4aaa-95cd-b3d3cc9650c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-262418768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef63f256-9f45-43bc-a735-68fb69fcb217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720c062e151e49218ab367824e5d4c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:16Z,use_quota=True,user_id='768d137fd53d4d0c9979a56b507d81ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fc10e4e-63e3-4cef-930c-e73cc5d0c2ac),volume_type_id=9fc10e4e-63e3-4cef-930c-e73cc5d0c2ac)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37b2caa-7497-4ccc-b319-52d1ce02a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37b2caa-7497-4ccc-b319-52d1ce02a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edeb7c8-a2d2-4ffb-89c4-e60374f98faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edeb7c8-a2d2-4ffb-89c4-e60374f98faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef63f256-9f45-43bc-a735-68fb69fcb217', 'volume_name': 'volume-ef63f256-9f45-43bc-a735-68fb69fcb217', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f609fe6f-72a2-48fc-81ee-53dabf5d0757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f609fe6f-72a2-48fc-81ee-53dabf5d0757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea02bf7-6431-438b-b833-31b730ab3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Volume ef63f256-9f45-43bc-a735-68fb69fcb217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef63f256-9f45-43bc-a735-68fb69fcb217', 'volume_size': 1} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-262418768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef63f256-9f45-43bc-a735-68fb69fcb217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720c062e151e49218ab367824e5d4c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:16Z,use_quota=True,user_id='768d137fd53d4d0c9979a56b507d81ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fc10e4e-63e3-4cef-930c-e73cc5d0c2ac),volume_type_id=9fc10e4e-63e3-4cef-930c-e73cc5d0c2ac)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Creating volume ef63f256-9f45-43bc-a735-68fb69fcb217 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:16 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:16 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 1073741824 Jul 03 17:33:16 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-42dae912-b406-4a66-8625-c8b7f5de957e tempest-VolumesSnapshotTestJSON-1503055265 None] Created volume successfully. Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-32a8886e-876d-48c7-b703-60bcf9efe4c3-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-32a8886e-876d-48c7-b703-60bcf9efe4c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-32a8886e-876d-48c7-b703-60bcf9efe4c3" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-32a8886e-876d-48c7-b703-60bcf9efe4c3" acquired by "delete_volume" :: waited 0.034s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[257cdb07-64ed-42e6-9f7f-5f762799dc88]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:16 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 Jul 03 17:33:16 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:17 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 1073741824" returned: 0 in 1.194s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:17 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 Jul 03 17:33:17 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:17 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3" returned: 0 in 1.128s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:17 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3 Jul 03 17:33:17 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:18 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217" returned: 0 in 0.813s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea02bf7-6431-438b-b833-31b730ab3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef63f256-9f45-43bc-a735-68fb69fcb217', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5f03c0-d0e6-4515-afaf-140522b94520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Volume volume-ef63f256-9f45-43bc-a735-68fb69fcb217 (ef63f256-9f45-43bc-a735-68fb69fcb217): created successfully Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5f03c0-d0e6-4515-afaf-140522b94520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Flow 'volume_create_manager' (1bdfe247-2852-4317-bd0c-666a5d86d5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9ecd3b68-c79d-4af6-9a11-75df9ae80339 tempest-VolumeTypesAccessTest-2073402626 None] Created volume successfully. Jul 03 17:33:18 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-32a8886e-876d-48c7-b703-60bcf9efe4c3" returned: 0 in 0.753s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-32a8886e-876d-48c7-b703-60bcf9efe4c3" released by "delete_volume" :: held 1.950s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['58e31a26-90e9-465c-8246-7874e044399c', 'f78ce78b-8b55-4562-a5a8-0f2a1a8c242b', '02f3acb1-e672-44be-9622-b1c1a912bd07', '2d0636d8-3792-4fd9-9c95-6a3a356bb764'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:18 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:18 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-9e453753-1e8b-43fb-a7b5-81013b8c7729-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-9e453753-1e8b-43fb-a7b5-81013b8c7729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-49179bde-89df-40d9-841c-cb70c270e4a9" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-49179bde-89df-40d9-841c-cb70c270e4a9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-9e453753-1e8b-43fb-a7b5-81013b8c7729" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-9e453753-1e8b-43fb-a7b5-81013b8c7729" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Deleting offline snapshot 9e453753-1e8b-43fb-a7b5-81013b8c7729 of volume 49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] snapshot_file for this snap is: volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ace87-bce2-42bc-95d1-45bcdc2db40b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:19 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 Jul 03 17:33:19 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Acquiring lock "cinder-ef63f256-9f45-43bc-a735-68fb69fcb217-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:19 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.825s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:19 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Deleted volume successfully. Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Lock "cinder-ef63f256-9f45-43bc-a735-68fb69fcb217-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Acquiring lock "cinder-quobyte-ef63f256-9f45-43bc-a735-68fb69fcb217" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-44141c4a-1a71-493c-92b7-a502e60f48af tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-32a8886e-876d-48c7-b703-60bcf9efe4c3-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Lock "cinder-quobyte-ef63f256-9f45-43bc-a735-68fb69fcb217" acquired by "delete_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011942f-e7eb-4d65-ad35-21f43911df61]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:19 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 Jul 03 17:33:19 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:20 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729" returned: 0 in 1.152s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49179bde-89df-40d9-841c-cb70c270e4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:33:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c5127-7afb-46fa-9324-9b9a45ac2976]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:20 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:33:20 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:20 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217" returned: 0 in 1.048s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:20 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217 Jul 03 17:33:20 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:21 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 0.872s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:21 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 Jul 03 17:33:21 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Flow 'volume_create_manager' (ed2a3925-fa8d-4022-80a5-fda329d7f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279b4a44-168a-4d4c-9632-7ad3c2285471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279b4a44-168a-4d4c-9632-7ad3c2285471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1207630276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebeba97-3eab-4206-8282-3281121e5f4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b030d24087704f05bf163ee78bea79e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:21Z,use_quota=True,user_id='487aea13150a4842a71ff289017f1b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79498df2-9419-4be5-9a78-4dc18b72277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79498df2-9419-4be5-9a78-4dc18b72277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309697c6-9823-487d-a5c5-0263a18aec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309697c6-9823-487d-a5c5-0263a18aec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebeba97-3eab-4206-8282-3281121e5f4e', 'volume_name': 'volume-2ebeba97-3eab-4206-8282-3281121e5f4e', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5daa3d-eb69-47d8-8974-bca3fe31c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5daa3d-eb69-47d8-8974-bca3fe31c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605933b2-3625-4881-b272-46c9eb6b1409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Volume 2ebeba97-3eab-4206-8282-3281121e5f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebeba97-3eab-4206-8282-3281121e5f4e', 'volume_size': 1} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1207630276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebeba97-3eab-4206-8282-3281121e5f4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b030d24087704f05bf163ee78bea79e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:21Z,use_quota=True,user_id='487aea13150a4842a71ff289017f1b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Creating volume 2ebeba97-3eab-4206-8282-3281121e5f4e {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:21 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:21 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e 1073741824 Jul 03 17:33:21 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:21 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ef63f256-9f45-43bc-a735-68fb69fcb217" returned: 0 in 0.794s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Lock "cinder-quobyte-ef63f256-9f45-43bc-a735-68fb69fcb217" released by "delete_volume" :: held 1.912s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:21 devstack cinder-volume[86621]: WARNING cinder.quota [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2125503303 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2125503303, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:33:21 devstack cinder-volume[86621]: WARNING cinder.quota [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2125503303 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2125503303, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Created reservations ['d7225b97-bc2f-4100-bde9-7f66a149cfeb', '547121d8-4329-4fd5-a137-918c0d9d2c59', '2ceec2d2-90b8-4778-a6e4-6199840c2a6a', 'c2b72df2-7d94-471e-8b19-cfd608185039'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:21 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:21 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:22 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729" returned: 0 in 1.007s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:22 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729 Jul 03 17:33:22 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:22 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e 1073741824" returned: 0 in 1.128s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:22 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e Jul 03 17:33:22 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:22 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.968s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Deleted volume successfully. Jul 03 17:33:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2b510e57-ae78-4c2a-990b-7d7a0526993d tempest-VolumeTypesAccessTest-2073402626 None] Lock "cinder-ef63f256-9f45-43bc-a735-68fb69fcb217-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:23 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9.9e453753-1e8b-43fb-a7b5-81013b8c7729" returned: 0 in 0.883s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-9e453753-1e8b-43fb-a7b5-81013b8c7729" released by "_delete_snapshot" :: held 4.048s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-49179bde-89df-40d9-841c-cb70c270e4a9" released by "delete_snapshot" :: held 4.079s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['48180c1d-0a58-4ad9-9597-ded9ca95a448', '8e105e9f-c53a-4238-bf05-462467afaa88', '5b22c7cb-3685-4dc2-afac-9f38dcf116dd', '7530bd26-bc20-40fc-ac04-a5c81a50b20c'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Delete snapshot completed successfully. Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40204f00-f522-4c50-8eb5-972c51a659ab tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-9e453753-1e8b-43fb-a7b5-81013b8c7729-delete_snapshot" released by "delete_snapshot" :: held 4.271s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:23 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e" returned: 0 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605933b2-3625-4881-b272-46c9eb6b1409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebeba97-3eab-4206-8282-3281121e5f4e', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edbde47-e5ac-4aa5-9d19-e336f2b1d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:23 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Volume volume-2ebeba97-3eab-4206-8282-3281121e5f4e (2ebeba97-3eab-4206-8282-3281121e5f4e): created successfully Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edbde47-e5ac-4aa5-9d19-e336f2b1d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Flow 'volume_create_manager' (ed2a3925-fa8d-4022-80a5-fda329d7f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-fc3f1651-911e-4c78-83f3-405eb0ceb5f8 req-97c11820-c003-4cfb-b4fb-b755397cb42c tempest-VolumesGetTestJSON-1846194245 None] Created volume successfully. Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-49179bde-89df-40d9-841c-cb70c270e4a9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-49179bde-89df-40d9-841c-cb70c270e4a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-20b67ece-3a56-4864-a17f-737f6f502086 tempest-GroupsV320Test-1089593774 None] Group tempest-GroupsV320Test-Group-499565856: creating Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-49179bde-89df-40d9-841c-cb70c270e4a9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-49179bde-89df-40d9-841c-cb70c270e4a9" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-20b67ece-3a56-4864-a17f-737f6f502086 tempest-GroupsV320Test-1089593774 None] Group tempest-GroupsV320Test-Group-499565856: created successfully Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03e440-bb0d-431c-8fa5-60e3e28a5603]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-20b67ece-3a56-4864-a17f-737f6f502086 tempest-GroupsV320Test-1089593774 None] Create group completed successfully. Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Acquiring lock "cinder-2ebeba97-3eab-4206-8282-3281121e5f4e-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Lock "cinder-2ebeba97-3eab-4206-8282-3281121e5f4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Acquiring lock "cinder-quobyte-2ebeba97-3eab-4206-8282-3281121e5f4e" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:24 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:33:24 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Lock "cinder-quobyte-2ebeba97-3eab-4206-8282-3281121e5f4e" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d5ca0-c5d2-46d5-8081-b7a2016d258f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:24 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e Jul 03 17:33:24 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:25 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 0.843s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:25 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9 Jul 03 17:33:25 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:25 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e" returned: 0 in 1.013s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:25 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e Jul 03 17:33:25 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Created reservations ['ab48e8c1-5ee8-428c-b67f-a345da985d78'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:26 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-49179bde-89df-40d9-841c-cb70c270e4a9" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-49179bde-89df-40d9-841c-cb70c270e4a9" released by "delete_volume" :: held 1.829s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:26 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:26 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['023abd07-af88-48b4-9034-db6711d9eb67', '1825b099-1a25-43d3-9e34-884ac98f6a96', '10d7c6b2-424e-4eaf-b0e9-7bd92e1fee0d', '6144e855-6130-4f5a-859c-cbe55ed76da2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:26 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:26 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:26 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ebeba97-3eab-4206-8282-3281121e5f4e" returned: 0 in 0.871s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Lock "cinder-quobyte-2ebeba97-3eab-4206-8282-3281121e5f4e" released by "delete_volume" :: held 1.945s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.quota [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Created reservations ['6ea7980e-cccd-4ca4-9d3b-15c7238d6ee0', 'cd8616e1-8a69-4882-80e4-0821c3fe72b3', 'ea972a29-2fe8-48f4-b09d-a09273e7a1d8', '9d2bad1f-458a-4399-8b66-55c419480be8'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:26 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:26 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:27 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.852s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a450cdfa-ac59-4f3c-ae92-65561dcdebe3 tempest-GroupsV320Test-1089593774 None] Delete group completed successfully. Jul 03 17:33:27 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.220s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Deleted volume successfully. Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e25dff6-7ac5-4c3b-9dd6-de2af336b715 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-49179bde-89df-40d9-841c-cb70c270e4a9-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:27 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (ecd704d9-9eba-406e-acb1-075b8f495610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747adfc2-de44-4f20-a9a7-49133e1bbdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.884s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.manager [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747adfc2-de44-4f20-a9a7-49133e1bbdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1174130809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f802b5b4-b704-46a0-8326-df539dd4e975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:28Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c529c1-3c66-48c2-96a5-cc0f7159e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c529c1-3c66-48c2-96a5-cc0f7159e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199c5cfe-9edb-40ec-a939-97cfb8359461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199c5cfe-9edb-40ec-a939-97cfb8359461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f802b5b4-b704-46a0-8326-df539dd4e975', 'volume_name': 'volume-f802b5b4-b704-46a0-8326-df539dd4e975', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8daed28-bbf3-4344-9e8c-22563d4d8060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8daed28-bbf3-4344-9e8c-22563d4d8060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b05519-49b4-43c8-b5ae-f8c84dfdcaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:27 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume f802b5b4-b704-46a0-8326-df539dd4e975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f802b5b4-b704-46a0-8326-df539dd4e975', 'volume_size': 1} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1174130809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f802b5b4-b704-46a0-8326-df539dd4e975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:28Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating volume f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:27 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Deleted volume successfully. Jul 03 17:33:27 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 1073741824 Jul 03 17:33:27 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-e3bad3cc-42a0-492b-acd3-dee792c6056a req-363ef738-1349-4116-80fd-05a489964055 tempest-VolumesGetTestJSON-1846194245 None] Lock "cinder-2ebeba97-3eab-4206-8282-3281121e5f4e-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:28 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 1073741824" returned: 0 in 0.937s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:28 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:28 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:29 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b05519-49b4-43c8-b5ae-f8c84dfdcaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f802b5b4-b704-46a0-8326-df539dd4e975', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f898ca3-8d1b-4635-860b-6a27a9ab3c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:29 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume volume-f802b5b4-b704-46a0-8326-df539dd4e975 (f802b5b4-b704-46a0-8326-df539dd4e975): created successfully Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f898ca3-8d1b-4635-860b-6a27a9ab3c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (ecd704d9-9eba-406e-acb1-075b8f495610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6a45272f-7255-4523-820b-0b3a60323764 tempest-VolumesSnapshotTestJSON-1503055265 None] Created volume successfully. Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Flow 'volume_create_manager' (84dc2836-77b5-4f51-b39f-d6b6480ed472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb2cdbf-a252-4a6f-99c3-b36d0fc373ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb2cdbf-a252-4a6f-99c3-b36d0fc373ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-466718973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552672c22a1f4141b759557a07292698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:31Z,use_quota=True,user_id='85c6459aee3a407bbe2d1e3f55f6a952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b44c90b-0a31-457c-abc0-18c226483070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b44c90b-0a31-457c-abc0-18c226483070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b0b363-8991-43bf-bbba-9f28a4350b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:30 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating offline snapshot c8af0687-cfa0-4470-acdf-8e1173a9a377 of volume f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d55e01-0b47-4287-8dd8-b69884910148]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:31 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:31 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b0b363-8991-43bf-bbba-9f28a4350b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c', 'volume_name': 'volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f65326b-d3ff-4958-834e-4388bae3cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f65326b-d3ff-4958-834e-4388bae3cc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77bb47d-9009-4825-a524-a73421cf8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Volume 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Trying to clone 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:33:31 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Image download 20.69 MB at 20.69 MB/s Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d1e79e-8518-4206-b709-81e6ab83c009]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:32 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD Jul 03 17:33:32 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:32 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 1.093s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:32 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 1G Jul 03 17:33:32 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Flow 'volume_create_manager' (9b749420-f1a5-4b75-a9ab-40ba09d91bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b4b49b-cb93-4910-80f5-230a04f0f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b4b49b-cb93-4910-80f5-230a04f0f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1291820046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99915eee-e8e3-489d-b981-1234f222cdac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bb4d80f50b5447cba062398419aa7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:33Z,use_quota=True,user_id='f2f1e644b73b40ab8523b685407b7048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5c7f01-3913-4bc8-a119-c70a740fe820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5c7f01-3913-4bc8-a119-c70a740fe820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146a5470-6c5c-452b-aab8-c99084e9682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146a5470-6c5c-452b-aab8-c99084e9682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99915eee-e8e3-489d-b981-1234f222cdac', 'volume_name': 'volume-99915eee-e8e3-489d-b981-1234f222cdac', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9921bd73-22e7-464b-9bc9-6541c2aa16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9921bd73-22e7-464b-9bc9-6541c2aa16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daaf625-1ced-416c-81ea-ed4368fcc72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:32 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Volume 99915eee-e8e3-489d-b981-1234f222cdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99915eee-e8e3-489d-b981-1234f222cdac', 'volume_size': 1} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:32 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD" returned: 0 in 0.975s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 is fetched for user 85c6459aee3a407bbe2d1e3f55f6a952. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1893f22a-406d-4386-a6f0-8a7fc0d62d85]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:33 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD Jul 03 17:33:33 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:33 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 1G" returned: 0 in 1.015s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f802b5b4-b704-46a0-8326-df539dd4e975 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:33 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f802b5b4-b704-46a0-8326-df539dd4e975 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 Jul 03 17:33:33 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:33 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:33 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f802b5b4-b704-46a0-8326-df539dd4e975 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:33 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 is being set with open permissions: ugo+rw Jul 03 17:33:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:33 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 Jul 03 17:33:33 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:34 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:34 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info Jul 03 17:33:34 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:35 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info" returned: 0 in 0.693s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:35 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info is being set with open permissions: ugo+rw Jul 03 17:33:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:35 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info Jul 03 17:33:35 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:35 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.info" returned: 0 in 0.677s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.058s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.221s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1291820046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99915eee-e8e3-489d-b981-1234f222cdac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bb4d80f50b5447cba062398419aa7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:33Z,use_quota=True,user_id='f2f1e644b73b40ab8523b685407b7048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Creating volume 99915eee-e8e3-489d-b981-1234f222cdac {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:36 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:36 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac 1073741824 Jul 03 17:33:36 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-163219a1-31d0-4f08-8325-54c222740642 tempest-VolumesSnapshotTestJSON-1503055265 None] Create snapshot completed successfully Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (f2ad668c-9c2b-4b30-8901-de2c0ccd4a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a512538b-dd0f-4779-89f4-da8543dd3773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a512538b-dd0f-4779-89f4-da8543dd3773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524653771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c8f581-45e8-403e-aeed-37893839b874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7172f0f6d874e88bcce12aedc2829c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8af0687-cfa0-4470-acdf-8e1173a9a377,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:37Z,use_quota=True,user_id='78a5fbb47d944a09bdea7bb7e7af2489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe524026-199f-421c-85d7-f402f9d96326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe524026-199f-421c-85d7-f402f9d96326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47dc8a4-e61a-4415-8708-d12620dbe94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47dc8a4-e61a-4415-8708-d12620dbe94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55c8f581-45e8-403e-aeed-37893839b874', 'volume_name': 'volume-55c8f581-45e8-403e-aeed-37893839b874', 'volume_size': 1, 'snapshot_id': 'c8af0687-cfa0-4470-acdf-8e1173a9a377'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8abd072-4a70-48c3-a360-ebb1bb5eef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8abd072-4a70-48c3-a360-ebb1bb5eef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a0fdce-9649-422d-9597-f816af8e45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume 55c8f581-45e8-403e-aeed-37893839b874: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55c8f581-45e8-403e-aeed-37893839b874', 'volume_size': 1, 'snapshot_id': 'c8af0687-cfa0-4470-acdf-8e1173a9a377'} Jul 03 17:33:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:36 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac 1073741824" returned: 0 in 0.906s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:37 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac Jul 03 17:33:37 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:37 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac" returned: 0 in 0.644s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.905s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-466718973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552672c22a1f4141b759557a07292698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:31Z,use_quota=True,user_id='85c6459aee3a407bbe2d1e3f55f6a952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Creating volume 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:37 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daaf625-1ced-416c-81ea-ed4368fcc72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99915eee-e8e3-489d-b981-1234f222cdac', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d369a1cf-1ecd-4aee-a3b4-5fc2f494da1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:37 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c 1073741824 Jul 03 17:33:37 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:37 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Volume volume-99915eee-e8e3-489d-b981-1234f222cdac (99915eee-e8e3-489d-b981-1234f222cdac): created successfully Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d369a1cf-1ecd-4aee-a3b4-5fc2f494da1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Flow 'volume_create_manager' (9b749420-f1a5-4b75-a9ab-40ba09d91bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f25ee8d6-7747-474f-83dc-a708a76a7631 tempest-VolumesTestJSON-811410585 None] Created volume successfully. Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:38 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Flow 'volume_create_manager' (bc5a6848-15be-4f35-9a6c-47be3ce261f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1288d2be-eb37-4f0d-9ef1-eb82f109ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c 1073741824" returned: 0 in 1.032s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1288d2be-eb37-4f0d-9ef1-eb82f109ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-585272043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ae0b45-9526-43aa-b912-e28dc79e59cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bb4d80f50b5447cba062398419aa7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:39Z,use_quota=True,user_id='f2f1e644b73b40ab8523b685407b7048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9d12cd-cbc0-4cb4-a731-c268875978cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9d12cd-cbc0-4cb4-a731-c268875978cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995bcfb5-3ee1-4392-8996-ea3ec4bff288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995bcfb5-3ee1-4392-8996-ea3ec4bff288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ae0b45-9526-43aa-b912-e28dc79e59cc', 'volume_name': 'volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bff1e8-8238-4096-b59a-c04549bbb91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bff1e8-8238-4096-b59a-c04549bbb91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91de9a2e-9829-4782-909a-d4681c1b1789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Volume e2ae0b45-9526-43aa-b912-e28dc79e59cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc', 'volume_size': 1} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:38 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:38 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:39 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 0 in 0.628s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.521s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-c8af0687-cfa0-4470-acdf-8e1173a9a377-55c8f581-45e8-403e-aeed-37893839b874" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-c8af0687-cfa0-4470-acdf-8e1173a9a377-55c8f581-45e8-403e-aeed-37893839b874" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating volume 55c8f581-45e8-403e-aeed-37893839b874 from snapshot c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-55c8f581-45e8-403e-aeed-37893839b874" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Attempting download of f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-55c8f581-45e8-403e-aeed-37893839b874" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] snapshot: c8af0687-cfa0-4470-acdf-8e1173a9a377, volume: 55c8f581-45e8-403e-aeed-37893839b874, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e702a47a-24e4-449d-ba46-d0e5fafec8f1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f305adf-5433-458c-ae57-5f67da6663f1]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:39 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 Jul 03 17:33:39 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:39 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx Jul 03 17:33:39 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:40 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx" returned: 0 in 0.747s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:40 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f802b5b4-b704-46a0-8326-df539dd4e975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb5ea4-c67b-425b-ad9f-da7f94945097]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:40 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx Jul 03 17:33:40 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:40 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:40 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:41 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx" returned: 1 in 0.749s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_ibw01wbx' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99205806-ab7e-4ee9-965a-6ad296c72eef]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:41 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD Jul 03 17:33:41 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:41 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 0.894s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:33:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:41 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 Jul 03 17:33:41 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:42 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD" returned: 0 in 0.936s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:42 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] f57dcfb6-0eab-4021-8a48-1dea93bf40e3 was qcow2, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:33:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:42 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:42 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:43 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:43 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:45 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.575s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:45 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:33:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:33:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:33:46 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 0 in 4.706s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:46 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_4kkuptd6devstack@QuobyteHD, size 112.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:33:46 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Converted 112.00 MB image at 23.80 MB/s Jul 03 17:33:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:46 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c 1G Jul 03 17:33:46 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:47 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874" returned: 0 in 6.270s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e2c310-9d31-43bc-831b-73d32812ce44]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:47 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:47 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:47 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c 1G" returned: 0 in 1.027s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d745f8-6a94-4de3-b670-8e00941819ca]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:47 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:47 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:48 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 0 in 0.775s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:48 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 1.054s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:48 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:33:48 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Converted 1024.00 MB image at 163.29 MB/s Jul 03 17:33:48 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 is being set with open permissions: ugo+rw Jul 03 17:33:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:48 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 Jul 03 17:33:48 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:48 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:48 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=65,cinder:SELECT=44,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:33:49 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874" returned: 0 in 0.863s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:DELETE=5,cinder:SELECT=54,cinder:UPDATE=54,cinder:INSERT=12 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-55c8f581-45e8-403e-aeed-37893839b874" released by "_copy_volume_from_snapshot" :: held 10.021s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-c8af0687-cfa0-4470-acdf-8e1173a9a377-55c8f581-45e8-403e-aeed-37893839b874" released by "_create_volume_from_snapshot" :: held 10.075s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.097s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.764s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-585272043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ae0b45-9526-43aa-b912-e28dc79e59cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bb4d80f50b5447cba062398419aa7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:39Z,use_quota=True,user_id='f2f1e644b73b40ab8523b685407b7048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Creating volume e2ae0b45-9526-43aa-b912-e28dc79e59cc {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:49 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:49 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc 1073741824 Jul 03 17:33:49 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a0fdce-9649-422d-9597-f816af8e45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c8f581-45e8-403e-aeed-37893839b874', 'volume_size': 1, 'snapshot_id': 'c8af0687-cfa0-4470-acdf-8e1173a9a377'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e557e4e3-ec89-43e5-81ea-e3962d5eb6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:49 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:49 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Volume volume-55c8f581-45e8-403e-aeed-37893839b874 (55c8f581-45e8-403e-aeed-37893839b874): created successfully Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e557e4e3-ec89-43e5-81ea-e3962d5eb6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Flow 'volume_create_manager' (f2ad668c-9c2b-4b30-8901-de2c0ccd4a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 1 in 1.083s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Downloaded image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 for user 85c6459aee3a407bbe2d1e3f55f6a952 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Marking volume 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Copying metadata from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 to 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Creating volume glance metadata for volume 7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c backed by image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:33:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cfbae00b-f1bc-485c-a687-fb9f26b2b244 tempest-VolumesSnapshotTestJSON-1503055265 None] Created volume successfully. Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77bb47d-9009-4825-a524-a73421cf8be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47684f6a-de88-45e4-acd5-7a9e3491e53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:49 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Volume volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c (7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c): created successfully Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47684f6a-de88-45e4-acd5-7a9e3491e53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Flow 'volume_create_manager' (84dc2836-77b5-4f51-b39f-d6b6480ed472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-43c9bda9-4d77-47d1-b397-b1523c24be09 tempest-VolumesImageMetadata-1864135770 None] Created volume successfully. Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-55c8f581-45e8-403e-aeed-37893839b874-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-55c8f581-45e8-403e-aeed-37893839b874-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-55c8f581-45e8-403e-aeed-37893839b874" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-55c8f581-45e8-403e-aeed-37893839b874" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5f034-8d4a-459c-9596-759a58b5a608]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:50 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 Jul 03 17:33:50 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:50 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc 1073741824" returned: 0 in 1.315s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:50 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc Jul 03 17:33:50 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Acquiring lock "cinder-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Lock "cinder-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Acquiring lock "cinder-quobyte-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Lock "cinder-quobyte-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c730ff-bb82-44aa-a2b1-1ef3cea2e5bf]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:51 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:51 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:51 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874" returned: 0 in 1.112s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:51 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874 Jul 03 17:33:51 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:51 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc" returned: 0 in 0.858s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91de9a2e-9829-4782-909a-d4681c1b1789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d675b211-f495-458e-9466-1ae0c0c0a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:51 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Volume volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc (e2ae0b45-9526-43aa-b912-e28dc79e59cc): created successfully Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d675b211-f495-458e-9466-1ae0c0c0a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Flow 'volume_create_manager' (bc5a6848-15be-4f35-9a6c-47be3ce261f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7f9d0c14-e819-4472-b411-1df93d4e1840 tempest-VolumesTestJSON-811410585 None] Created volume successfully. Jul 03 17:33:52 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 0 in 0.997s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:52 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-55c8f581-45e8-403e-aeed-37893839b874" returned: 0 in 0.903s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-55c8f581-45e8-403e-aeed-37893839b874" released by "delete_volume" :: held 2.074s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:52 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:52 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['ee87744e-586e-4ce1-9305-056fb641dd74', 'aeca3dc1-8a66-4801-8502-d238bafbc524', 'e897ee34-a443-42e6-9433-981d6cd59731', '1a436586-2d98-48f9-a424-476c3cdc4df3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:52 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:52 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Flow 'volume_create_manager' (dbc48f8f-9418-4275-83f8-a8cff33f7353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15491044-17b8-4120-a714-a601274a9081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15491044-17b8-4120-a714-a601274a9081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1647421538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ed2a71-907c-4052-8738-8ca18618bcc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bb4d80f50b5447cba062398419aa7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:53Z,use_quota=True,user_id='f2f1e644b73b40ab8523b685407b7048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552dbd85-c148-4485-a76f-1d80deadfba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552dbd85-c148-4485-a76f-1d80deadfba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33a641-177e-4179-af26-6e86da9edbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33a641-177e-4179-af26-6e86da9edbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ed2a71-907c-4052-8738-8ca18618bcc9', 'volume_name': 'volume-19ed2a71-907c-4052-8738-8ca18618bcc9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93768cac-4743-4252-af7d-49d76f1e6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93768cac-4743-4252-af7d-49d76f1e6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77945652-9607-4991-9345-f8af2c0789ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:52 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Volume 19ed2a71-907c-4052-8738-8ca18618bcc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ed2a71-907c-4052-8738-8ca18618bcc9', 'volume_size': 1} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1647421538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ed2a71-907c-4052-8738-8ca18618bcc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bb4d80f50b5447cba062398419aa7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:33:53Z,use_quota=True,user_id='f2f1e644b73b40ab8523b685407b7048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Creating volume 19ed2a71-907c-4052-8738-8ca18618bcc9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:33:52 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:33:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:53 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 1073741824 Jul 03 17:33:53 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:53 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 1 in 1.020s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:53 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c Jul 03 17:33:53 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:53 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.923s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Deleted volume successfully. Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c98908d6-8358-41c1-a98d-c316cc32abee tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-55c8f581-45e8-403e-aeed-37893839b874-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-c8af0687-cfa0-4470-acdf-8e1173a9a377-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-c8af0687-cfa0-4470-acdf-8e1173a9a377-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-f802b5b4-b704-46a0-8326-df539dd4e975" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-f802b5b4-b704-46a0-8326-df539dd4e975" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-c8af0687-cfa0-4470-acdf-8e1173a9a377" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-c8af0687-cfa0-4470-acdf-8e1173a9a377" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Deleting offline snapshot c8af0687-cfa0-4470-acdf-8e1173a9a377 of volume f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] snapshot_file for this snap is: volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a7edb6-57ce-4cc4-badd-137ea30d1cad]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:53 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 Jul 03 17:33:53 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:53 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 1073741824" returned: 0 in 0.949s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" returned: 0 in 0.796s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:53 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:54 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 Jul 03 17:33:54 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Lock "cinder-quobyte-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c" released by "delete_volume" :: held 2.915s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Created reservations ['7a640673-d03b-4c86-9213-9ad416e67597', '94af5fd0-3105-4ee4-9e5c-59c606738b85', '06ac1c4c-6916-408a-921f-0b0f6b68304c', '477634f2-d1a9-42db-82ba-dd99b63f4dff'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:54 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:54 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:54 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377" returned: 0 in 1.009s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f802b5b4-b704-46a0-8326-df539dd4e975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f149b4c-3255-4caa-98c8-3c79413caabe]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:54 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9" returned: 0 in 0.890s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77945652-9607-4991-9345-f8af2c0789ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ed2a71-907c-4052-8738-8ca18618bcc9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b7668-1a90-433d-b32a-eb7b76ecbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:33:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Volume volume-19ed2a71-907c-4052-8738-8ca18618bcc9 (19ed2a71-907c-4052-8738-8ca18618bcc9): created successfully Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b7668-1a90-433d-b32a-eb7b76ecbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:33:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Flow 'volume_create_manager' (dbc48f8f-9418-4275-83f8-a8cff33f7353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:33:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b3095448-87c5-4fbc-9f61-76b6f2feb898 tempest-VolumesTestJSON-811410585 None] Created volume successfully. Jul 03 17:33:54 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:54 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:55 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.897s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:55 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:33:55 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Deleted volume successfully. Jul 03 17:33:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c803ffb0-f764-432f-b15c-6cf4cf39bec9 tempest-VolumesImageMetadata-1864135770 None] Lock "cinder-7c76c0aa-9cac-403f-8c7a-2c5f151a2f9c-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:55 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 0.991s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:55 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 Jul 03 17:33:55 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:56 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377" returned: 0 in 0.978s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:56 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377 Jul 03 17:33:56 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Acquiring lock "cinder-19ed2a71-907c-4052-8738-8ca18618bcc9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Lock "cinder-19ed2a71-907c-4052-8738-8ca18618bcc9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Acquiring lock "cinder-quobyte-19ed2a71-907c-4052-8738-8ca18618bcc9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Lock "cinder-quobyte-19ed2a71-907c-4052-8738-8ca18618bcc9" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:57 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975.c8af0687-cfa0-4470-acdf-8e1173a9a377" returned: 0 in 0.816s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b9e24-a0b7-4eab-b72d-5199cf0796f0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-c8af0687-cfa0-4470-acdf-8e1173a9a377" released by "_delete_snapshot" :: held 3.965s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-f802b5b4-b704-46a0-8326-df539dd4e975" released by "delete_snapshot" :: held 4.007s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['b431eec8-23e8-4f5b-a072-5bb70d554f7b', '3ef82be5-72ac-4f15-b50c-818a0359f5e4', '2c06fe45-9659-467e-b8a8-c1b5577f8bfb', 'b8789e29-2d70-4f0d-9894-c8d22f64c35a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:57 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 Jul 03 17:33:57 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Delete snapshot completed successfully. Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-10f181e6-35ac-47d1-8f75-a9ecd86c4676 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-c8af0687-cfa0-4470-acdf-8e1173a9a377-delete_snapshot" released by "delete_snapshot" :: held 4.228s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-f802b5b4-b704-46a0-8326-df539dd4e975-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-f802b5b4-b704-46a0-8326-df539dd4e975-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-f802b5b4-b704-46a0-8326-df539dd4e975" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:33:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-f802b5b4-b704-46a0-8326-df539dd4e975" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:33:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b0ceba-b213-4071-aaae-6fc469ae90cd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:33:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:58 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:58 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:58 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9" returned: 0 in 1.074s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:58 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9 Jul 03 17:33:58 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:59 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 1.008s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:59 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975 Jul 03 17:33:59 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:59 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19ed2a71-907c-4052-8738-8ca18618bcc9" returned: 0 in 0.819s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Lock "cinder-quobyte-19ed2a71-907c-4052-8738-8ca18618bcc9" released by "delete_volume" :: held 2.047s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Created reservations ['90762704-27ad-450c-b5d5-7c4b55c8710f', '082fecc8-0e28-4cd2-b43b-77c2ec5f97e3', '777af995-7153-4be4-97ea-e5bafb53bfa4', 'cf3b04e3-a74d-4ed9-b032-7ed1eebf79b8'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:33:59 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:33:59 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:33:59 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f802b5b4-b704-46a0-8326-df539dd4e975" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:33:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-f802b5b4-b704-46a0-8326-df539dd4e975" released by "delete_volume" :: held 1.929s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['560f7b18-4c12-46d6-9555-bdf26c202956', '2fcc0e24-f0fa-4f94-b7b6-782fb6c2cd81', '47dd484f-13b1-454e-8346-628d2e3a60e2', 'c87810a0-61ab-45c8-aadc-df8efa3b446b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:00 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:00 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-01337e08-cd88-4cb6-953a-5615752e1379-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-01337e08-cd88-4cb6-953a-5615752e1379-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "cinder-quobyte-01337e08-cd88-4cb6-953a-5615752e1379" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-01337e08-cd88-4cb6-953a-5615752e1379" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:00 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.015s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Acquiring lock "cinder-e2ae0b45-9526-43aa-b912-e28dc79e59cc-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed92ea8-48c8-49a4-8fe8-dda01ee96513]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Deleted volume successfully. Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Lock "cinder-e2ae0b45-9526-43aa-b912-e28dc79e59cc-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8633a5c0-2b3f-40d4-a575-c6da212a10da tempest-VolumesTestJSON-811410585 None] Lock "cinder-19ed2a71-907c-4052-8738-8ca18618bcc9-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:00 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 Jul 03 17:34:00 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Acquiring lock "cinder-quobyte-e2ae0b45-9526-43aa-b912-e28dc79e59cc" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Lock "cinder-quobyte-e2ae0b45-9526-43aa-b912-e28dc79e59cc" acquired by "delete_volume" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4904ce-bf7f-4250-8b45-a35148c4d827]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:01 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.006s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Deleted volume successfully. Jul 03 17:34:01 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d1b77d7b-8088-444f-b225-666c999a1328 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-f802b5b4-b704-46a0-8326-df539dd4e975-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:01 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:01 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379" returned: 0 in 0.938s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:01 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379 Jul 03 17:34:01 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:02 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc" returned: 0 in 1.019s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:02 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc Jul 03 17:34:02 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Flow 'volume_create_manager' (fd38f2d8-3ae4-42fc-bc57-d830fc7602fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957e0a9b-f54c-4a63-bcd4-d2b45e9c2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957e0a9b-f54c-4a63-bcd4-d2b45e9c2d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-670810499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79658ddcc2a04253a158b16751a797d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:02Z,use_quota=True,user_id='5f2f7ea8ba8d443690e1b81a1b6562d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735ff946-f73a-4392-ae5f-107e476c3f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735ff946-f73a-4392-ae5f-107e476c3f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41c3d00-1eeb-4832-8d27-4ced887f9e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41c3d00-1eeb-4832-8d27-4ced887f9e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe', 'volume_name': 'volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f524475a-e1f2-485f-a891-4d6c8a641383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f524475a-e1f2-485f-a891-4d6c8a641383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6391d0-6972-46e8-a45b-a520a0e421cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:02 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Volume ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe', 'volume_size': 1} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-670810499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79658ddcc2a04253a158b16751a797d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:02Z,use_quota=True,user_id='5f2f7ea8ba8d443690e1b81a1b6562d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Creating volume ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:34:02 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:02 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe 1073741824 Jul 03 17:34:02 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:02 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-01337e08-cd88-4cb6-953a-5615752e1379" returned: 0 in 0.891s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-quobyte-01337e08-cd88-4cb6-953a-5615752e1379" released by "delete_volume" :: held 1.931s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Created reservations ['a4049a46-f24e-4d0d-8868-32db33abf06f', 'dd5fd55d-ac51-40c0-83ed-0ae7ad2292b8', '73d9d141-6226-437c-ab7f-8d6dc18c5495', '375668b3-e6d4-4915-9adf-603da1702ab6'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:02 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e2ae0b45-9526-43aa-b912-e28dc79e59cc" returned: 0 in 0.767s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Lock "cinder-quobyte-e2ae0b45-9526-43aa-b912-e28dc79e59cc" released by "delete_volume" :: held 1.902s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:02 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:02 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:02 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Created reservations ['8f1f433b-3e01-4994-9ab8-7f2466610907', 'c2882111-2a26-4a6f-8908-a37053fa50f6', '54408f1d-6361-48e5-af79-3292f8ad4b52', 'fa228578-524e-4846-b7d0-2f5189f29cfe'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:03 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:03 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Acquiring lock "cinder-99915eee-e8e3-489d-b981-1234f222cdac-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Lock "cinder-99915eee-e8e3-489d-b981-1234f222cdac-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Acquiring lock "cinder-quobyte-99915eee-e8e3-489d-b981-1234f222cdac" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Lock "cinder-quobyte-99915eee-e8e3-489d-b981-1234f222cdac" acquired by "delete_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366bea9-3f19-452e-954f-8155de8841d9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:03 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac Jul 03 17:34:03 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:03 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.981s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Deleted volume successfully. Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-360ddee8-da6c-4a04-9702-b3bd2155e7b0 tempest-VolumesSnapshotTestJSON-1503055265 None] Lock "cinder-01337e08-cd88-4cb6-953a-5615752e1379-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:03 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe 1073741824" returned: 0 in 1.383s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:03 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:03 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.285s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:04 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Deleted volume successfully. Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-54b02d4a-0ae8-4e7f-96b5-00629501c233 tempest-VolumesTestJSON-811410585 None] Lock "cinder-e2ae0b45-9526-43aa-b912-e28dc79e59cc-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:04 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac" returned: 0 in 1.299s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:04 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac Jul 03 17:34:04 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 1.027s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:04 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] <== create_volume: return (2475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:34:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6391d0-6972-46e8-a45b-a520a0e421cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc6b101-2d3a-46fb-bf36-ee8bd8e847b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Volume volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe (ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe): created successfully Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc6b101-2d3a-46fb-bf36-ee8bd8e847b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Flow 'volume_create_manager' (fd38f2d8-3ae4-42fc-bc57-d830fc7602fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-94cb1c11-3657-4e70-9df2-5590a6747eef tempest-VolumesDeleteCascade-1250524006 None] Created volume successfully. Jul 03 17:34:05 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-99915eee-e8e3-489d-b981-1234f222cdac" returned: 0 in 0.772s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Lock "cinder-quobyte-99915eee-e8e3-489d-b981-1234f222cdac" released by "delete_volume" :: held 2.148s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Created reservations ['3be4ae90-966e-4695-9ee9-abf6696a3ad9', 'b92b86ee-b69a-45eb-a092-75cf6aca39e4', 'fa669e0d-1ae9-44f9-940b-fdb7fa6e5012', 'd4569dce-8f20-4a4b-a7de-c383ed88ca22'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:05 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:05 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Creating offline snapshot 29695761-ce1f-447e-b5ef-c3cc9ec80ec3 of volume ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c58ae53-48e1-4a83-a019-eda1161e124e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:06 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:06 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:06 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Deleted volume successfully. Jul 03 17:34:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9e2a2283-4138-400f-a957-47a4b0467478 tempest-VolumesTestJSON-811410585 None] Lock "cinder-99915eee-e8e3-489d-b981-1234f222cdac-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:07 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 0.912s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:07 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 1G Jul 03 17:34:07 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:08 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 1G" returned: 0 in 1.088s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:08 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:08 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:08 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 0.883s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:08 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 is being set with open permissions: ugo+rw Jul 03 17:34:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:09 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:09 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:09 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:09 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info Jul 03 17:34:09 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:10 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:10 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info is being set with open permissions: ugo+rw Jul 03 17:34:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:10 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info Jul 03 17:34:10 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:11 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.info" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.318s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-250fadf3-0cf2-40d1-bf85-271b8075ca8a tempest-VolumesDeleteCascade-1250524006 None] Create snapshot completed successfully Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Flow 'volume_create_manager' (79060765-ec94-4a24-998c-44c17b631e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d01739-fa39-4c61-8bc1-268b08b24c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d01739-fa39-4c61-8bc1-268b08b24c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-235922174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae730e7-aad8-468e-a164-a117fecb4a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef433ac97bdc47389081d7f9c2b70cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:12Z,use_quota=True,user_id='51af89068a144fdb982301534968aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a80b06-b9ee-4a0e-a3e4-b6357675b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a80b06-b9ee-4a0e-a3e4-b6357675b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba26c44-8a0f-44f0-92f6-cec338802447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba26c44-8a0f-44f0-92f6-cec338802447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae730e7-aad8-468e-a164-a117fecb4a6a', 'volume_name': 'volume-5ae730e7-aad8-468e-a164-a117fecb4a6a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec89ca40-a1c7-4058-8a0b-3505db07f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec89ca40-a1c7-4058-8a0b-3505db07f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8fcdfd-a5ff-4924-b022-8164b19bf976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Volume 5ae730e7-aad8-468e-a164-a117fecb4a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae730e7-aad8-468e-a164-a117fecb4a6a', 'volume_size': 1} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-235922174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae730e7-aad8-468e-a164-a117fecb4a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef433ac97bdc47389081d7f9c2b70cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:12Z,use_quota=True,user_id='51af89068a144fdb982301534968aa57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Creating volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:34:11 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:34:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:11 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a 1073741824 Jul 03 17:34:11 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:12 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a 1073741824" returned: 0 in 1.072s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:13 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a Jul 03 17:34:13 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:13 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a" returned: 0 in 0.824s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.219s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8fcdfd-a5ff-4924-b022-8164b19bf976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae730e7-aad8-468e-a164-a117fecb4a6a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5beb1ca-cc34-4382-872e-0d7f684a9817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Creating offline snapshot e705a3bf-e27f-47c5-a6c0-391b080b80a6 of volume ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Volume volume-5ae730e7-aad8-468e-a164-a117fecb4a6a (5ae730e7-aad8-468e-a164-a117fecb4a6a): created successfully Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5beb1ca-cc34-4382-872e-0d7f684a9817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Flow 'volume_create_manager' (79060765-ec94-4a24-998c-44c17b631e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f19eb-cce3-4057-8b95-0cdb209e10b5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-98b08cee-6a8e-4a4c-9133-b06a7ce6bd06 tempest-SnapshotsActionsTest-875248299 None] Created volume successfully. Jul 03 17:34:14 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:14 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:15 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 1.055s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:15 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 1G Jul 03 17:34:15 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:15 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 1G" returned: 0 in 0.962s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:16 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 Jul 03 17:34:16 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:16 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6" returned: 0 in 0.717s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:16 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 is being set with open permissions: ugo+rw Jul 03 17:34:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:16 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 Jul 03 17:34:16 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:17 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6" returned: 0 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.683s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.158s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Creating offline snapshot 1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:17 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8e74ed91-1813-4e4b-8f3c-4db939808b18 tempest-VolumesDeleteCascade-1250524006 None] Create snapshot completed successfully Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b449403-21ba-422f-b034-3fe8092cf650]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:17 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a Jul 03 17:34:17 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Performing cascade delete. {{(pid=86621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-29695761-ce1f-447e-b5ef-c3cc9ec80ec3-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-29695761-ce1f-447e-b5ef-c3cc9ec80ec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-29695761-ce1f-447e-b5ef-c3cc9ec80ec3" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-29695761-ce1f-447e-b5ef-c3cc9ec80ec3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Deleting offline snapshot 29695761-ce1f-447e-b5ef-c3cc9ec80ec3 of volume ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] snapshot_file for this snap is: volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7162b5ac-cae3-4078-a210-94e680ce92c2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:18 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:18 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:18 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a" returned: 0 in 0.982s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:18 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 1G Jul 03 17:34:18 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:19 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 1.071s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c275736-9488-47ba-8a7f-15a613244ee1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:19 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:19 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:19 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 1G" returned: 0 in 1.115s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:19 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:19 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:20 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 1.068s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9821e6c7-6e4b-4daf-8b72-59363561fb55]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:20 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 Jul 03 17:34:20 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:20 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.123s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:20 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 is being set with open permissions: ugo+rw Jul 03 17:34:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:20 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:20 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:22 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.217s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:22 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6" returned: 0 in 1.495s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[70120ff8-ddda-47ed-8eb2-d5f5a5fb163a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:22 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info Jul 03 17:34:22 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:22 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:22 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:22 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info" returned: 0 in 0.817s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:22 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info is being set with open permissions: ugo+rw Jul 03 17:34:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:22 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info Jul 03 17:34:22 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:23 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 0.979s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[919688f4-e443-4215-8dce-1f9f8df11e62]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:23 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:23 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:23 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.info" returned: 0 in 0.813s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.230s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-821f2e57-8cee-4710-aa81-f7e8c93f7ab1 tempest-SnapshotsActionsTest-875248299 None] Create snapshot completed successfully Jul 03 17:34:23 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 0.911s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:24 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:24 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:24 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 0.781s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:24 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3 Jul 03 17:34:24 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:25 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.29695761-ce1f-447e-b5ef-c3cc9ec80ec3" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 -F qcow2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:25 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 -F qcow2 Jul 03 17:34:25 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Creating offline snapshot 32ee8cae-5408-4622-b67c-7245aa1dabe3 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89b438b-0835-4e96-ba70-ada5780ef860]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:25 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:25 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:26 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 -F qcow2" returned: 0 in 0.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-29695761-ce1f-447e-b5ef-c3cc9ec80ec3" released by "_delete_snapshot" :: held 8.115s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" released by "delete_snapshot" :: held 8.142s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Created reservations ['a6072cb6-77f0-4043-a372-20c4d26ac7fb', '826dfc52-2850-4b76-932a-5852b01a3a51', 'c5b59ed3-83ee-48a7-b291-f758fe704553', 'a3a8ece4-8119-41c5-a02c-a504daee9229'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:26 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Delete snapshot completed successfully. Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-29695761-ce1f-447e-b5ef-c3cc9ec80ec3-delete_snapshot" released by "delete_snapshot" :: held 8.308s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-e705a3bf-e27f-47c5-a6c0-391b080b80a6-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-e705a3bf-e27f-47c5-a6c0-391b080b80a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:26 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-e705a3bf-e27f-47c5-a6c0-391b080b80a6" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 0.852s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-e705a3bf-e27f-47c5-a6c0-391b080b80a6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Deleting offline snapshot e705a3bf-e27f-47c5-a6c0-391b080b80a6 of volume ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:34:26 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 1G Jul 03 17:34:26 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] snapshot_file for this snap is: volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af3e17-8736-40fd-beac-4316323c79d5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:26 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 Jul 03 17:34:26 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:27 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 1G" returned: 0 in 0.956s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:27 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6" returned: 0 in 0.879s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:27 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 Jul 03 17:34:27 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a041ff-c5fe-4aea-9dc7-bed82442cd52]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:27 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:27 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:28 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3" returned: 0 in 0.835s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:28 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 is being set with open permissions: ugo+rw Jul 03 17:34:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:28 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 Jul 03 17:34:28 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:28 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 0.957s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:28 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 Jul 03 17:34:28 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:29 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3" returned: 0 in 0.826s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d031f270-8063-4be7-bd36-6078cc709505 tempest-SnapshotsActionsTest-875248299 None] Create snapshot completed successfully Jul 03 17:34:29 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6" returned: 0 in 0.851s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:29 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6 Jul 03 17:34:29 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-32ee8cae-5408-4622-b67c-7245aa1dabe3-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-32ee8cae-5408-4622-b67c-7245aa1dabe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-32ee8cae-5408-4622-b67c-7245aa1dabe3" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-32ee8cae-5408-4622-b67c-7245aa1dabe3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Deleting offline snapshot 32ee8cae-5408-4622-b67c-7245aa1dabe3 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] snapshot_file for this snap is: volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98e49b9-2270-4506-bc92-4cd00044cc0d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:30 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe.e705a3bf-e27f-47c5-a6c0-391b080b80a6" returned: 0 in 1.048s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-e705a3bf-e27f-47c5-a6c0-391b080b80a6" released by "_delete_snapshot" :: held 3.928s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" released by "delete_snapshot" :: held 3.966s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:30 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 Jul 03 17:34:30 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Created reservations ['12039b59-2700-4948-9329-4fd05ae6a185', '7741b7e4-4a8e-4563-8e8f-606ebe2f46df', '197e1ef1-b81d-41e8-b1fe-d141375d2665', '605566bd-6eba-42bd-a1e1-bd030f3b02f3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Delete snapshot completed successfully. Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-e705a3bf-e27f-47c5-a6c0-391b080b80a6-delete_snapshot" released by "delete_snapshot" :: held 4.171s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Snapshots deleted, issuing volume delete {{(pid=86621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[31202d58-f73d-4d72-9f67-5e2b9be59454]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:30 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:30 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:31 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3" returned: 0 in 1.324s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a3b77-2033-42a0-ba1d-727b7625c359]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:31 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:31 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:31 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 1.263s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:32 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe Jul 03 17:34:32 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:32 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:34:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (21ed2adf-8bd8-4495-8de3-58a894e28468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82bd6f6-e410-4658-a692-962fde03e0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82bd6f6-e410-4658-a692-962fde03e0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1073928089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e529ac7-8977-4043-9da0-5f32e8fc4930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:33Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e1335-8b62-4365-b188-b575f94e4121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:33 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e1335-8b62-4365-b188-b575f94e4121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7c0bb0-a3c8-47e4-b32d-6650ba85d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7c0bb0-a3c8-47e4-b32d-6650ba85d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e529ac7-8977-4043-9da0-5f32e8fc4930', 'volume_name': 'volume-8e529ac7-8977-4043-9da0-5f32e8fc4930', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7833f7b-c022-402c-a272-7c33793a8973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7833f7b-c022-402c-a272-7c33793a8973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e163094f-afcc-4be9-bfef-2cf1cf8b33a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Volume 8e529ac7-8977-4043-9da0-5f32e8fc4930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e529ac7-8977-4043-9da0-5f32e8fc4930', 'volume_size': 1} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1073928089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e529ac7-8977-4043-9da0-5f32e8fc4930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:33Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Creating volume 8e529ac7-8977-4043-9da0-5f32e8fc4930 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:33 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:34:33 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" returned: 0 in 1.184s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.445s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:33 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 1073741824 Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe" released by "delete_volume" :: held 2.576s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:33 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:33 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 Jul 03 17:34:33 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Created reservations ['c0e13649-2dfb-4062-9f54-667295c48c9f', 'bec581d2-4ab9-4c42-8e8f-7fcabd3f9bcd', '43e755d0-eee8-4c3b-b671-d314fe164b08', '1a72e862-c007-42ac-b354-5786c4a11355'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:33 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:33 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Flow 'volume_create_manager' (10667d96-778a-4046-89fc-98e11a2ad34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dad4db-16e1-40c8-8d26-11ce31d03c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:34 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dad4db-16e1-40c8-8d26-11ce31d03c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2033332978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfaf03-c904-4afc-9ea7-f3d37d1b297c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79658ddcc2a04253a158b16751a797d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:35Z,use_quota=True,user_id='5f2f7ea8ba8d443690e1b81a1b6562d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097135ae-6ff7-4448-b785-56cf44d4fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097135ae-6ff7-4448-b785-56cf44d4fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333f95fc-d71b-42a1-9ab4-feffde87b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333f95fc-d71b-42a1-9ab4-feffde87b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedfaf03-c904-4afc-9ea7-f3d37d1b297c', 'volume_name': 'volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68069525-3716-4be8-bdcb-84233967bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68069525-3716-4be8-bdcb-84233967bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67b485d-a3b2-411b-bb10-fafaaefc074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Volume cedfaf03-c904-4afc-9ea7-f3d37d1b297c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c', 'volume_size': 1} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3" returned: 0 in 1.710s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:34 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3 Jul 03 17:34:34 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:34 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 1073741824" returned: 0 in 1.846s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:35 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:35 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 Jul 03 17:34:35 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Deleted volume successfully. Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-40ee59b5-6269-442d-bf88-d627d648a5fd tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-ea9fb0d9-5c7d-492c-bd10-da1e1b7f1fbe-delete_volume" released by "delete_volume" :: held 17.151s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:35 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.32ee8cae-5408-4622-b67c-7245aa1dabe3" returned: 0 in 0.950s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-32ee8cae-5408-4622-b67c-7245aa1dabe3" released by "_delete_snapshot" :: held 5.674s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" released by "delete_snapshot" :: held 5.715s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:36 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930" returned: 0 in 0.969s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] <== create_volume: return (2926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.928s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2033332978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfaf03-c904-4afc-9ea7-f3d37d1b297c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79658ddcc2a04253a158b16751a797d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:35Z,use_quota=True,user_id='5f2f7ea8ba8d443690e1b81a1b6562d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Creating volume cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:34:36 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Created reservations ['b0190a02-e933-4ce1-a2d4-1b3d189f2c0c', '5f18b17e-5374-4589-a569-61c68cdded3b', 'aa82e7b6-5b9d-4005-8ae5-2ca57838a4b6', '5aed9e08-d35a-49b3-8d41-34183c603df3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:36 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c 1073741824 Jul 03 17:34:36 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e163094f-afcc-4be9-bfef-2cf1cf8b33a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e529ac7-8977-4043-9da0-5f32e8fc4930', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b684c-6059-4183-ba30-dc1caecf745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Volume volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 (8e529ac7-8977-4043-9da0-5f32e8fc4930): created successfully Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b684c-6059-4183-ba30-dc1caecf745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (21ed2adf-8bd8-4495-8de3-58a894e28468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1c399137-960c-4904-9b2c-6b5244cb95f4 tempest-VolumesActionsTest-2117153237 None] Created volume successfully. Jul 03 17:34:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Delete snapshot completed successfully. Jul 03 17:34:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a5874d93-c092-46e3-b1bd-93942e68adc8 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-32ee8cae-5408-4622-b67c-7245aa1dabe3-delete_snapshot" released by "delete_snapshot" :: held 6.018s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1d0bbd41-2af3-45f4-8d12-2b982787fe17 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930" by "attach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1d0bbd41-2af3-45f4-8d12-2b982787fe17 tempest-VolumesActionsTest-2117153237 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930" acquired by "attach_volume" :: waited 0.044s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:37 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c 1073741824" returned: 0 in 1.223s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1d0bbd41-2af3-45f4-8d12-2b982787fe17 tempest-VolumesActionsTest-2117153237 None] Attaching volume 8e529ac7-8977-4043-9da0-5f32e8fc4930 to instance 34909af8-247d-49d0-b9d2-e1957bb6bf21 at mountpoint /dev/vdb on host None. Jul 03 17:34:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1d0bbd41-2af3-45f4-8d12-2b982787fe17 tempest-VolumesActionsTest-2117153237 None] Attach volume completed successfully. Jul 03 17:34:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1d0bbd41-2af3-45f4-8d12-2b982787fe17 tempest-VolumesActionsTest-2117153237 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930" released by "attach_volume" :: held 0.174s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:37 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:34:37 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:38 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 0.799s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.877s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Creating offline snapshot 9a882518-ae85-490e-ac69-6d544609ca07 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67b485d-a3b2-411b-bb10-fafaaefc074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada6c69b-eabb-47c5-a34c-3db4a1b82511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebe2345-5b3e-4325-b0b3-75b3cd78822b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Volume volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c (cedfaf03-c904-4afc-9ea7-f3d37d1b297c): created successfully Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada6c69b-eabb-47c5-a34c-3db4a1b82511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Flow 'volume_create_manager' (10667d96-778a-4046-89fc-98e11a2ad34e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8e7e886c-06e5-4637-ac32-6df516b2c2dd tempest-VolumesDeleteCascade-1250524006 None] Created volume successfully. Jul 03 17:34:38 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:38 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ea369fd8-5c10-4bb7-a8f7-7bef837b6a11 tempest-VolumesActionsTest-924391184 None] Terminate volume connection completed successfully. Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea369fd8-5c10-4bb7-a8f7-7bef837b6a11 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-detach_volume" by "detach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea369fd8-5c10-4bb7-a8f7-7bef837b6a11 tempest-VolumesActionsTest-924391184 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ea369fd8-5c10-4bb7-a8f7-7bef837b6a11 tempest-VolumesActionsTest-924391184 None] Detaching volume 8e529ac7-8977-4043-9da0-5f32e8fc4930 from instance 34909af8-247d-49d0-b9d2-e1957bb6bf21. Jul 03 17:34:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ea369fd8-5c10-4bb7-a8f7-7bef837b6a11 tempest-VolumesActionsTest-924391184 None] Detach volume completed successfully. Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea369fd8-5c10-4bb7-a8f7-7bef837b6a11 tempest-VolumesActionsTest-924391184 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:39 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.158s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:39 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 1G Jul 03 17:34:39 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e6593109-41c9-4c69-95ca-d2bca7bf5abb tempest-VolumesActionsTest-2117153237 None] Acquiring lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-detach_volume" by "detach_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e6593109-41c9-4c69-95ca-d2bca7bf5abb tempest-VolumesActionsTest-2117153237 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e6593109-41c9-4c69-95ca-d2bca7bf5abb tempest-VolumesActionsTest-2117153237 None] Volume detach called, but volume not attached. Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e6593109-41c9-4c69-95ca-d2bca7bf5abb tempest-VolumesActionsTest-2117153237 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:40 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 1G" returned: 0 in 1.008s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:40 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 Jul 03 17:34:40 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "cinder-quobyte-8e529ac7-8977-4043-9da0-5f32e8fc4930" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Lock "cinder-quobyte-8e529ac7-8977-4043-9da0-5f32e8fc4930" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[70695373-be1f-4f22-b706-ee873f5cf3a2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:40 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 Jul 03 17:34:40 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:41 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07" returned: 0 in 0.956s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:41 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 is being set with open permissions: ugo+rw Jul 03 17:34:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:41 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 Jul 03 17:34:41 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:41 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930" returned: 0 in 0.873s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:41 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930 Jul 03 17:34:41 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:42 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07" returned: 0 in 0.718s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.066s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.783s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Creating offline snapshot 977dd8ad-c0a4-4b50-99a3-4128b074fc21 of volume cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-15cbb0e1-f2bf-41a2-a24b-659dde56a10d tempest-SnapshotsActionsTest-875248299 None] Create snapshot completed successfully Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc82f4-ce4f-4a32-96b4-c11e40fd5c1c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:42 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:34:42 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:42 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8e529ac7-8977-4043-9da0-5f32e8fc4930" returned: 0 in 0.681s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Lock "cinder-quobyte-8e529ac7-8977-4043-9da0-5f32e8fc4930" released by "delete_volume" :: held 1.594s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Created reservations ['049ebffe-fc93-4d43-9887-15a02a6857f9', '885f4e77-7261-47f6-858e-0e132b26bda1', '5bf84c41-4cd8-4201-9635-7a625e3a59a1', '1cfbd9e5-a4a1-436f-8e5f-eec8106d3c4e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:42 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:42 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-9a882518-ae85-490e-ac69-6d544609ca07-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-9a882518-ae85-490e-ac69-6d544609ca07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-9a882518-ae85-490e-ac69-6d544609ca07" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-9a882518-ae85-490e-ac69-6d544609ca07" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Deleting offline snapshot 9a882518-ae85-490e-ac69-6d544609ca07 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] snapshot_file for this snap is: volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c7ae89-3d7d-43bd-8666-3774daa1b048]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:42 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 Jul 03 17:34:42 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:43 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 0.996s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:43 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 1G Jul 03 17:34:43 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:43 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.963s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Deleted volume successfully. Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-09cb999d-26db-4a64-8a6a-1868b8fe8437 tempest-VolumesActionsTest-2117153237 None] Lock "cinder-8e529ac7-8977-4043-9da0-5f32e8fc4930-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:43 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:34:43 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:43 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07" returned: 0 in 1.032s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a310afec-35de-405f-a3bb-1ee0c435fa6d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:44 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:44 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:44 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 1G" returned: 0 in 0.900s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:44 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 Jul 03 17:34:44 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:44 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:34:44 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.084s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:45 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 Jul 03 17:34:45 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:45 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21" returned: 0 in 1.057s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:45 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 is being set with open permissions: ugo+rw Jul 03 17:34:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:45 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 Jul 03 17:34:45 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:45 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07" returned: 0 in 0.892s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:45 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07 Jul 03 17:34:45 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:45 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21" returned: 0 in 0.731s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:46 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info Jul 03 17:34:46 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:46 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.9a882518-ae85-490e-ac69-6d544609ca07" returned: 0 in 0.775s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-9a882518-ae85-490e-ac69-6d544609ca07" released by "_delete_snapshot" :: held 3.908s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" released by "delete_snapshot" :: held 3.938s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:46 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info" returned: 0 in 0.761s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:46 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info is being set with open permissions: ugo+rw Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:46 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info Jul 03 17:34:46 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Created reservations ['5b90a29d-2c26-416d-b0bc-84ce238a63c4', '2d8fc646-4d92-4cfb-a358-ae3a23784a00', '863bd532-f285-48e1-9be5-5b7f9b25a754', 'b80049b3-2559-490e-86ab-28c035ff3303'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:46 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Delete snapshot completed successfully. Jul 03 17:34:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d4efe17b-6e9b-418e-8eb7-31f0773dbd0e tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-9a882518-ae85-490e-ac69-6d544609ca07-delete_snapshot" released by "delete_snapshot" :: held 4.118s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:47 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.info" returned: 0 in 0.765s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.319s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.171s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Creating offline snapshot b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:34:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b8675951-6c1d-4a54-bf53-17f48556b0c9 tempest-VolumesDeleteCascade-1250524006 None] Create snapshot completed successfully Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5422a59-cf13-4ed5-baa3-c810450ce2b9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:47 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:47 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:34:48 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.054s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Flow 'volume_create_manager' (1ca7a8e8-9f0b-4fdb-b92a-d0e7f13c9996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2803774-e79f-4da9-9031-c4897a427006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:48 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 1G Jul 03 17:34:48 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2803774-e79f-4da9-9031-c4897a427006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-435629195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79658ddcc2a04253a158b16751a797d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=977dd8ad-c0a4-4b50-99a3-4128b074fc21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:49Z,use_quota=True,user_id='5f2f7ea8ba8d443690e1b81a1b6562d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a808c4-9486-43d5-b413-1f2ae931727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a808c4-9486-43d5-b413-1f2ae931727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce9345d-31fb-4597-84ec-0995ae06bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce9345d-31fb-4597-84ec-0995ae06bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af', 'volume_name': 'volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af', 'volume_size': 1, 'snapshot_id': '977dd8ad-c0a4-4b50-99a3-4128b074fc21'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcfdb11-8ee8-4a0e-ba47-801af53e081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcfdb11-8ee8-4a0e-ba47-801af53e081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b062f4c-c95e-4278-a3ce-97576f667cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Volume 8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af', 'volume_size': 1, 'snapshot_id': '977dd8ad-c0a4-4b50-99a3-4128b074fc21'} Jul 03 17:34:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:49 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 1G" returned: 0 in 0.997s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:49 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 Jul 03 17:34:49 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=135,cinder:SELECT=128,cinder:INSERT=37,cinder:DELETE=8 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=106,cinder:UPDATE=132,cinder:DELETE=15,cinder:INSERT=42 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (6857f1ac-95eb-40c5-a190-43360fad09dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb5ba5a-1207-4afb-9cd3-cd52bfd6197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb5ba5a-1207-4afb-9cd3-cd52bfd6197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1088153689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f98b898-e80a-4e2b-a1e0-d1a7c110a40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:50Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6269f2fb-4ee5-48f9-909a-fc7a6a6432a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6269f2fb-4ee5-48f9-909a-fc7a6a6432a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b48aa4f-299c-46d7-822e-d121347e0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b48aa4f-299c-46d7-822e-d121347e0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f98b898-e80a-4e2b-a1e0-d1a7c110a40a', 'volume_name': 'volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4154fb80-1dbe-4f08-b8ce-ef9beb907fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4154fb80-1dbe-4f08-b8ce-ef9beb907fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b942e7d-dd6c-479a-98ed-4041c0ed6245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:34:50 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Volume 3f98b898-e80a-4e2b-a1e0-d1a7c110a40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a', 'volume_size': 1} Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:50 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" returned: 0 in 0.894s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:50 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 is being set with open permissions: ugo+rw Jul 03 17:34:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:50 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 Jul 03 17:34:50 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:51 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" returned: 0 in 0.628s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.682s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.444s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-977dd8ad-c0a4-4b50-99a3-4128b074fc21-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-977dd8ad-c0a4-4b50-99a3-4128b074fc21-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Creating volume 8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af from snapshot 977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-008d9768-d7bf-4840-9e4c-5c70c875263b tempest-SnapshotsActionsTest-875248299 None] Create snapshot completed successfully Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] snapshot: 977dd8ad-c0a4-4b50-99a3-4128b074fc21, volume: 8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f383c-dec1-497f-b34e-3560559c43ca]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:51 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 Jul 03 17:34:51 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-b41ac4bd-e3da-4ec7-8028-3dd3ca294b58-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-b41ac4bd-e3da-4ec7-8028-3dd3ca294b58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Deleting offline snapshot b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] snapshot_file for this snap is: volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d37a1-51da-4627-ab83-52d8e19fa458]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:51 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 Jul 03 17:34:51 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:52 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[493642b2-39d3-450d-90af-af9737271488]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:52 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:34:52 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:52 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" returned: 0 in 0.807s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c426de3-bbdf-4964-a4f0-5093318060ea]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:52 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:34:52 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:52 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:34:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:52 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af Jul 03 17:34:52 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:53 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 0.805s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:34:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:53 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 Jul 03 17:34:53 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:55 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" returned: 0 in 2.141s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:34:55 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58 Jul 03 17:34:55 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:34:57 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 03 17:34:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" returned: 0 in 2.089s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:34:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-b41ac4bd-e3da-4ec7-8028-3dd3ca294b58" released by "_delete_snapshot" :: held 6.037s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" released by "delete_snapshot" :: held 6.076s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:58 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Created reservations ['115810b4-1920-4ba7-a4ee-914dddbc2fb3', 'b7271522-af00-4493-a71e-6622d170de72', '5d23b842-26c7-4b83-b623-444b6bbe2f26', '6dc53bff-9e10-4f0b-9d55-010d0436727d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:34:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Delete snapshot completed successfully. Jul 03 17:34:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-897ff386-67ee-4728-ac35-6df464ba1af4 tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-b41ac4bd-e3da-4ec7-8028-3dd3ca294b58-delete_snapshot" released by "delete_snapshot" :: held 6.625s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:34:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:00 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" returned: 0 in 7.112s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6272fe2-7963-4eaf-9dd6-2951b3659cb9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:00 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:35:00 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:01 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 0.977s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:35:01 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Converted 1024.00 MB image at 143.97 MB/s Jul 03 17:35:01 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af is being set with open permissions: ugo+rw Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:01 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af Jul 03 17:35:01 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:01 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" returned: 0 in 0.658s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" released by "_copy_volume_from_snapshot" :: held 10.435s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-977dd8ad-c0a4-4b50-99a3-4128b074fc21-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" released by "_create_volume_from_snapshot" :: held 10.478s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.514s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.256s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1088153689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f98b898-e80a-4e2b-a1e0-d1a7c110a40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:34:50Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Creating volume 3f98b898-e80a-4e2b-a1e0-d1a7c110a40a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:01 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:01 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a 1073741824 Jul 03 17:35:01 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b062f4c-c95e-4278-a3ce-97576f667cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af', 'volume_size': 1, 'snapshot_id': '977dd8ad-c0a4-4b50-99a3-4128b074fc21'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a64117-b02f-48ed-a602-f92e3ab43184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:01 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Volume volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af (8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af): created successfully Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a64117-b02f-48ed-a602-f92e3ab43184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Flow 'volume_create_manager' (1ca7a8e8-9f0b-4fdb-b92a-d0e7f13c9996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e87ad504-e4be-4628-acf5-85ca9df71a6b tempest-VolumesDeleteCascade-1250524006 None] Created volume successfully. Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-cedfaf03-c904-4afc-9ea7-f3d37d1b297c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-cedfaf03-c904-4afc-9ea7-f3d37d1b297c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Performing cascade delete. {{(pid=86621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-977dd8ad-c0a4-4b50-99a3-4128b074fc21-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-977dd8ad-c0a4-4b50-99a3-4128b074fc21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-977dd8ad-c0a4-4b50-99a3-4128b074fc21" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-977dd8ad-c0a4-4b50-99a3-4128b074fc21" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Deleting offline snapshot 977dd8ad-c0a4-4b50-99a3-4128b074fc21 of volume cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] snapshot_file for this snap is: volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[328e004c-0626-4de4-a2d5-a5dd49c89e81]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:02 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 Jul 03 17:35:02 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:02 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a 1073741824" returned: 0 in 0.951s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:02 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a Jul 03 17:35:02 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:03 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0155ffbc-40cf-4d1e-af5e-09aa5e8c9b29]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:03 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a" returned: 0 in 0.642s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.220s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b942e7d-dd6c-479a-98ed-4041c0ed6245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66358e3b-b3ea-473a-97e6-1ad84f7f4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Creating offline snapshot 7f00a833-9968-42e3-8623-f25eee1e1844 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:35:03 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Volume volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a (3f98b898-e80a-4e2b-a1e0-d1a7c110a40a): created successfully Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66358e3b-b3ea-473a-97e6-1ad84f7f4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (6857f1ac-95eb-40c5-a190-43360fad09dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca378e-38e3-49c5-a69e-59658150e584]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:03 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:35:03 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f4958d9a-6b0a-41b9-960b-de3390c06d83 tempest-VolumesActionsTest-2117153237 None] Created volume successfully. Jul 03 17:35:03 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:35:03 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Lock "cinder-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-quobyte-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[239c1769-a2fe-4dd3-bcad-64cceebeddf3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:04 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a Jul 03 17:35:04 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:04 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 1.051s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:04 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 Jul 03 17:35:04 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:04 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 0.982s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:04 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 1G Jul 03 17:35:04 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:04 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a" returned: 0 in 0.890s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:04 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a Jul 03 17:35:04 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:05 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 1G" returned: 0 in 0.902s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:05 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 Jul 03 17:35:05 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:05 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21" returned: 0 in 1.021s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:05 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21 Jul 03 17:35:05 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:05 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a" returned: 0 in 0.817s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a" released by "delete_volume" :: held 1.779s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Created reservations ['097614a1-2c2c-470e-8d92-8c21ccc029d3', 'f3189733-dde5-46ff-bcf5-20c5bc2f3aa6', '81f4f770-716c-45d4-b3ca-2855e172a905', '42ded727-743d-4670-81d9-471e8f18fa83'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:05 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:05 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:06 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844" returned: 0 in 0.840s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:06 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 is being set with open permissions: ugo+rw Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:06 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 Jul 03 17:35:06 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:06 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c.977dd8ad-c0a4-4b50-99a3-4128b074fc21" returned: 0 in 0.869s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-977dd8ad-c0a4-4b50-99a3-4128b074fc21" released by "_delete_snapshot" :: held 3.819s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" released by "delete_snapshot" :: held 3.859s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Created reservations ['f0311e72-dcb8-4e43-8884-50c96bc6e6f6', '24251a9f-1840-49ff-a975-d6ea9a2ecdb6', '034dfafd-0f7b-4430-9d41-d2e0343d729d', 'cd6f6a15-c302-49ed-bd33-1e7845a64820'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Delete snapshot completed successfully. Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-977dd8ad-c0a4-4b50-99a3-4128b074fc21-delete_snapshot" released by "delete_snapshot" :: held 4.090s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Snapshots deleted, issuing volume delete {{(pid=86621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb2ab6f-2c6b-4f56-a832-723f5f3f8bda]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:06 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:35:06 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:06 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.063s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:06 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Deleted volume successfully. Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2578d15-fd39-4fbe-8d24-7a77b70fad54 tempest-VolumesActionsTest-924391184 None] Lock "cinder-3f98b898-e80a-4e2b-a1e0-d1a7c110a40a-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (4eac2a1d-c121-47d1-84d4-bc433ee4a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18e0d6c-f26c-40b2-83f9-f6ae9c9dd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18e0d6c-f26c-40b2-83f9-f6ae9c9dd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1919450869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624eebb8-338a-4a37-ab87-5ac7ddfe1374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:07Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ce2b25-87d3-4cfb-9fc2-347219eecf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ce2b25-87d3-4cfb-9fc2-347219eecf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696928c2-8a66-4029-84b2-14f744d97ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696928c2-8a66-4029-84b2-14f744d97ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624eebb8-338a-4a37-ab87-5ac7ddfe1374', 'volume_name': 'volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42eba85-8cc0-48d4-81a0-26ecf970030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42eba85-8cc0-48d4-81a0-26ecf970030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72b9815-0be8-4fa3-9e7c-61c7e2b88ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Volume 624eebb8-338a-4a37-ab87-5ac7ddfe1374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374', 'volume_size': 1} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:07 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844" returned: 0 in 1.068s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.924s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1919450869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624eebb8-338a-4a37-ab87-5ac7ddfe1374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:07Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Creating volume 624eebb8-338a-4a37-ab87-5ac7ddfe1374 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:07 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:07 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 1073741824 Jul 03 17:35:07 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-38961517-bde1-49ac-9e62-c7590598cfe2 tempest-SnapshotsActionsTest-875248299 None] Create snapshot completed successfully Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-7f00a833-9968-42e3-8623-f25eee1e1844-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-7f00a833-9968-42e3-8623-f25eee1e1844-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Acquiring lock "cinder-quobyte-7f00a833-9968-42e3-8623-f25eee1e1844" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-7f00a833-9968-42e3-8623-f25eee1e1844" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Deleting offline snapshot 7f00a833-9968-42e3-8623-f25eee1e1844 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] snapshot_file for this snap is: volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:35:07 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 1.157s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d803cec0-e25f-4a55-ba89-e4a2b572e33b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:07 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c Jul 03 17:35:07 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:07 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 Jul 03 17:35:07 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:08 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 1073741824" returned: 0 in 1.019s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:08 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 Jul 03 17:35:08 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:08 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-cedfaf03-c904-4afc-9ea7-f3d37d1b297c" released by "delete_volume" :: held 2.026s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Created reservations ['813af553-d2bb-433c-862b-75b96127e72c', '43cd36e2-8859-488f-9bba-610d2d0bdeae', '1303af73-6903-4047-92d0-4cd819bdbefd', 'c8a33e4f-c082-4750-9f01-30541be46b73'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:08 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844" returned: 0 in 0.896s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6616da93-034a-4d01-b955-c8043a7a7869]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:08 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:08 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:08 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:35:08 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:09 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374" returned: 0 in 0.872s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72b9815-0be8-4fa3-9e7c-61c7e2b88ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e0ebd3-1f5c-43f5-baa3-6c4929956541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Volume volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 (624eebb8-338a-4a37-ab87-5ac7ddfe1374): created successfully Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e0ebd3-1f5c-43f5-baa3-6c4929956541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (4eac2a1d-c121-47d1-84d4-bc433ee4a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-03091477-f73d-4f06-a0cd-717c6f2cbbae tempest-VolumesActionsTest-2117153237 None] Created volume successfully. Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "cinder-quobyte-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82c213-57bb-41ae-a926-b80a450dd39e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:09 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af Jul 03 17:35:09 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:09 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.860s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Deleted volume successfully. Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-11f8daa4-390f-4c79-aeaf-cded5012ce12 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-cedfaf03-c904-4afc-9ea7-f3d37d1b297c-delete_volume" released by "delete_volume" :: held 7.280s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:09 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 1.059s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:09 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 Jul 03 17:35:09 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:10 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" returned: 0 in 0.792s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:10 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af Jul 03 17:35:10 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-624eebb8-338a-4a37-ab87-5ac7ddfe1374-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Lock "cinder-624eebb8-338a-4a37-ab87-5ac7ddfe1374-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-quobyte-624eebb8-338a-4a37-ab87-5ac7ddfe1374" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-624eebb8-338a-4a37-ab87-5ac7ddfe1374" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e9fb1e-55b9-4a86-bf50-9ab2a5f9775e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:10 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844" returned: 0 in 0.834s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:10 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 Jul 03 17:35:10 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:10 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844 Jul 03 17:35:10 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:10 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-quobyte-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af" released by "delete_volume" :: held 1.489s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:10 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Created reservations ['bc453889-7a26-4cc2-befe-955641d553df', '16d92d41-c8d1-4800-96b6-aae65b34f7af', '1c91c717-0355-4d6a-b589-73417de27e18', 'c3eb5b4f-9665-435f-a3e9-5a14dc232a0a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:11 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:11 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:11 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.7f00a833-9968-42e3-8623-f25eee1e1844" returned: 0 in 0.676s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-7f00a833-9968-42e3-8623-f25eee1e1844" released by "_delete_snapshot" :: held 3.577s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" released by "delete_snapshot" :: held 3.625s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:11 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:11 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374 Jul 03 17:35:11 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Created reservations ['e8f0efb5-7f1c-46e3-9173-5911f6cbdeb8', '9a5b7978-f1f8-4908-9592-46d65bb7adf0', 'ca2f8690-d2c4-43ba-81f1-715d1988b17f', '80f51c1e-3e54-4f01-a0f4-c5ca70217e4a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Delete snapshot completed successfully. Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d5e350e9-d632-4ac9-92df-6f5761454e2f tempest-SnapshotsActionsTest-1614511974 None] Lock "cinder-7f00a833-9968-42e3-8623-f25eee1e1844-delete_snapshot" released by "delete_snapshot" :: held 3.828s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:11 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.658s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Deleted volume successfully. Jul 03 17:35:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2109cb43-5ed8-4d77-a08c-b115736836f1 tempest-VolumesDeleteCascade-1250524006 None] Lock "cinder-8aaacc8d-e84b-4dcd-8d0e-dcd1bc6438af-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:12 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-624eebb8-338a-4a37-ab87-5ac7ddfe1374" returned: 0 in 0.692s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-624eebb8-338a-4a37-ab87-5ac7ddfe1374" released by "delete_volume" :: held 1.562s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Created reservations ['64d30fb2-9f18-465d-9337-22b6d2013a43', 'a031789e-768b-472e-a4b9-0d21b14f579a', '683426b8-eb36-4c0f-bf29-d54fc75e7937', '2ed00678-65f2-46b8-bbd8-8c8567799907'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:12 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:12 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "cinder-1137c132-dc79-4c1a-9dbb-02e5bcb8abe6-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-1137c132-dc79-4c1a-9dbb-02e5bcb8abe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "cinder-quobyte-1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-quobyte-1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Deleting offline snapshot 1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 of volume 5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] snapshot_file for this snap is: volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1417c-f205-496e-a8c9-deb329b1dab5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:12 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:35:12 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:12 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.774s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:12 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Deleted volume successfully. Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-15986b2e-0bc3-4490-babd-94e875dbf5e2 tempest-VolumesActionsTest-924391184 None] Lock "cinder-624eebb8-338a-4a37-ab87-5ac7ddfe1374-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (fe8f4672-ac5d-4d63-8f9a-43eaedfc3974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4a22cc-6326-48ad-bea1-e0d393e17a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:13 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 0.887s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae730e7-aad8-468e-a164-a117fecb4a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4a22cc-6326-48ad-bea1-e0d393e17a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-147987255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:13Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2726b9d-a2f3-420d-85e7-d4a28b64fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2726b9d-a2f3-420d-85e7-d4a28b64fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93987d16-522b-446a-8931-5d7d350632bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93987d16-522b-446a-8931-5d7d350632bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2', 'volume_name': 'volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3532c83d-0c0d-4799-b095-5c01255199fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3532c83d-0c0d-4799-b095-5c01255199fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e089e05-0431-47e1-8846-f81cd882fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Volume 21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2', 'volume_size': 1} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-147987255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:13Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Creating volume 21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5835ef5d-30af-4e43-b727-2ec131184e69]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:13 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 1073741824 Jul 03 17:35:13 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:13 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a Jul 03 17:35:13 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:14 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a" returned: 0 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:14 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:35:14 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:14 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 1073741824" returned: 0 in 0.887s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:14 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 Jul 03 17:35:14 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Flow 'volume_create_manager' (db4a53e1-0d03-4dd9-98f3-abd5bb367fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce6cc1e-a433-4df0-9b2b-472ef95d3c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce6cc1e-a433-4df0-9b2b-472ef95d3c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-448082785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9302d56a-242a-473a-bc78-c63489dfa3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73de51c537f0493c8c21a95d7b53f552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:15Z,use_quota=True,user_id='98e7873d3fc44f5d9e7ba128384f9cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12659a4d-5bf5-490a-92ba-f81489b43114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12659a4d-5bf5-490a-92ba-f81489b43114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7414595-7b88-4422-94e0-a7f86b4f5358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7414595-7b88-4422-94e0-a7f86b4f5358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9302d56a-242a-473a-bc78-c63489dfa3e8', 'volume_name': 'volume-9302d56a-242a-473a-bc78-c63489dfa3e8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f16c38-c2be-46ba-8866-7172d16e0968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f16c38-c2be-46ba-8866-7172d16e0968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89e459-366f-4768-8600-5f8950836080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:14 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Volume 9302d56a-242a-473a-bc78-c63489dfa3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9302d56a-242a-473a-bc78-c63489dfa3e8', 'volume_size': 1} Jul 03 17:35:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:15 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-448082785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9302d56a-242a-473a-bc78-c63489dfa3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73de51c537f0493c8c21a95d7b53f552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:15Z,use_quota=True,user_id='98e7873d3fc44f5d9e7ba128384f9cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Creating volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:15 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:15 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 0.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:15 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 1073741824 Jul 03 17:35:15 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e089e05-0431-47e1-8846-f81cd882fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7bb247-b650-47e7-8f7b-0a9325f27209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:15 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6 Jul 03 17:35:15 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Volume volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 (21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2): created successfully Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7bb247-b650-47e7-8f7b-0a9325f27209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (fe8f4672-ac5d-4d63-8f9a-43eaedfc3974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a3667b3b-6c62-4978-800c-fe6a57c51ad0 tempest-VolumesActionsTest-2117153237 None] Created volume successfully. Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Lock "cinder-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-quobyte-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dba47a1-a144-429e-aa76-f064b8525e19]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:15 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a.1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-quobyte-1137c132-dc79-4c1a-9dbb-02e5bcb8abe6" released by "_delete_snapshot" :: held 3.406s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" released by "delete_snapshot" :: held 3.440s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:15 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 Jul 03 17:35:15 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Created reservations ['afc08403-c986-45a6-8a12-347bbc54d866', '86900143-8a97-4806-9638-9cf71655c654', '59cb1dee-4369-43ed-bdfd-cf22b2e79884', '6b456070-50f0-42be-a117-745b0d6d4d6f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Delete snapshot completed successfully. Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-50fc39c6-2a7a-4e0d-958f-6d96921bd438 tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-1137c132-dc79-4c1a-9dbb-02e5bcb8abe6-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:15 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 1073741824" returned: 0 in 0.946s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:16 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 Jul 03 17:35:16 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:16 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2" returned: 0 in 0.773s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:16 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2 Jul 03 17:35:16 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:16 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8" returned: 0 in 0.712s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89e459-366f-4768-8600-5f8950836080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9302d56a-242a-473a-bc78-c63489dfa3e8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1d007c-4bad-40fc-ab03-e340426a5741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Volume volume-9302d56a-242a-473a-bc78-c63489dfa3e8 (9302d56a-242a-473a-bc78-c63489dfa3e8): created successfully Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1d007c-4bad-40fc-ab03-e340426a5741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Flow 'volume_create_manager' (db4a53e1-0d03-4dd9-98f3-abd5bb367fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "cinder-5ae730e7-aad8-468e-a164-a117fecb4a6a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8c3b56e0-6577-455d-9080-3abdd2e172b3 tempest-VolumesSnapshotListTestJSON-1699998008 None] Created volume successfully. Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-5ae730e7-aad8-468e-a164-a117fecb4a6a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e5ab9e-8f81-4f53-b08a-d1c48f98091d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:17 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a Jul 03 17:35:17 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:17 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2" returned: 0 in 0.697s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2" released by "delete_volume" :: held 1.511s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Created reservations ['7b5618fc-dc5d-4a5b-b585-138ed761ec6c', '956efb5a-f991-4336-96b7-227915ca184f', '9abc842c-ca24-4a34-8f83-e90bd94de306', 'f0ea3ace-41be-4cdc-ad27-828949b419f6'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:17 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:17 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:17 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a" returned: 0 in 0.800s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:17 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a Jul 03 17:35:17 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:18 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.875s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Deleted volume successfully. Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Creating offline snapshot fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd of volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad765ab3-fa63-421f-b436-27c0d1c71962]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-72baf1fd-2964-4217-8ecd-5170c9499d59 tempest-VolumesActionsTest-924391184 None] Lock "cinder-21b53ee4-ce64-4aa9-8eb6-0ded6bb6bda2-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:18 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 Jul 03 17:35:18 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:18 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ae730e7-aad8-468e-a164-a117fecb4a6a" returned: 0 in 0.791s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-quobyte-5ae730e7-aad8-468e-a164-a117fecb4a6a" released by "delete_volume" :: held 1.659s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (c0e7911c-28d6-413e-b6bf-9e59ecf50dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5c0990-6a7d-4519-a720-5bedae900484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5c0990-6a7d-4519-a720-5bedae900484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1023703281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3dd459-b1c9-4c03-a6b1-01526004b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:19Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ad6c29-bbbc-4f02-8f58-50d9162268dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ad6c29-bbbc-4f02-8f58-50d9162268dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f154cc-e3f0-49d3-a9fb-86dd2239112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f154cc-e3f0-49d3-a9fb-86dd2239112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3dd459-b1c9-4c03-a6b1-01526004b681', 'volume_name': 'volume-2d3dd459-b1c9-4c03-a6b1-01526004b681', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e21a01-18ba-4a4e-abd3-ca3d4cba23be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e21a01-18ba-4a4e-abd3-ca3d4cba23be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8631b4-e999-4769-9c2c-3bf19ccad6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Volume 2d3dd459-b1c9-4c03-a6b1-01526004b681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3dd459-b1c9-4c03-a6b1-01526004b681', 'volume_size': 1} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Created reservations ['fcff187e-7030-4a8a-9507-a5cae8222200', '9316e027-67cf-42e4-893c-e76a7825252b', 'a0004f3f-1541-49fc-ab56-8a0615e4c06c', 'ac0f21d9-f7cc-49a6-a292-dc8184b0715b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:18 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:18 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:19 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:19 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd 1G Jul 03 17:35:19 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:19 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.638s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:19 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Deleted volume successfully. Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a0f91c38-83af-4fca-80bf-7f3295814ada tempest-SnapshotsActionsTest-875248299 None] Lock "cinder-5ae730e7-aad8-468e-a164-a117fecb4a6a-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:19 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd 1G" returned: 0 in 0.832s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:19 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:19 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:20 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 0.764s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:20 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd is being set with open permissions: ugo+rw Jul 03 17:35:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:20 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:20 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:21 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 0.753s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:21 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info Jul 03 17:35:21 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Flow 'volume_create_manager' (f2a7cc48-21cb-4b0e-9be7-7fd7ef089239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7492c24-7bb2-45f2-a63b-30e6412370c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7492c24-7bb2-45f2-a63b-30e6412370c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-35314865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bf58fc-5ce9-4681-a1fc-ee798bc43508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1324f9a4ca47ba9479eba6596b095b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:22Z,use_quota=True,user_id='9c86ef465381495b83ec5635cbd9dc72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f5d696-a17c-4df8-85fe-2787f38f9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f5d696-a17c-4df8-85fe-2787f38f9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8dfb98-e4d1-4750-a5f3-0f9c6bf2d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8dfb98-e4d1-4750-a5f3-0f9c6bf2d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53bf58fc-5ce9-4681-a1fc-ee798bc43508', 'volume_name': 'volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57fc348-1a48-4029-8c74-46382f0a753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57fc348-1a48-4029-8c74-46382f0a753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79629f1-b6ba-4fee-8ac8-9c6ebf541ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Volume 53bf58fc-5ce9-4681-a1fc-ee798bc43508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508', 'volume_size': 1} Jul 03 17:35:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:22 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info" returned: 0 in 0.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:22 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info is being set with open permissions: ugo+rw Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:22 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info Jul 03 17:35:22 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:22 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.info" returned: 0 in 0.648s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.633s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.160s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1023703281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3dd459-b1c9-4c03-a6b1-01526004b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:19Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Creating volume 2d3dd459-b1c9-4c03-a6b1-01526004b681 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:22 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 1073741824 Jul 03 17:35:22 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0c1b8013-a0af-40ae-8ba5-70605c45b8ff tempest-VolumesSnapshotListTestJSON-1699998008 None] Create snapshot completed successfully Jul 03 17:35:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:23 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 1073741824" returned: 0 in 0.909s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:23 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 Jul 03 17:35:23 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:24 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681" returned: 0 in 0.657s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.616s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-35314865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bf58fc-5ce9-4681-a1fc-ee798bc43508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1324f9a4ca47ba9479eba6596b095b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:22Z,use_quota=True,user_id='9c86ef465381495b83ec5635cbd9dc72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Creating volume 53bf58fc-5ce9-4681-a1fc-ee798bc43508 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:24 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8631b4-e999-4769-9c2c-3bf19ccad6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3dd459-b1c9-4c03-a6b1-01526004b681', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:24 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 1073741824 Jul 03 17:35:24 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2831b85-1181-45bc-80b8-f486d115062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Volume volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 (2d3dd459-b1c9-4c03-a6b1-01526004b681): created successfully Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2831b85-1181-45bc-80b8-f486d115062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (c0e7911c-28d6-413e-b6bf-9e59ecf50dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d2f29a42-9ce2-40b0-b2a6-88dbf5e3b6c7 tempest-VolumesActionsTest-2117153237 None] Created volume successfully. Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-2d3dd459-b1c9-4c03-a6b1-01526004b681-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Lock "cinder-2d3dd459-b1c9-4c03-a6b1-01526004b681-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Acquiring lock "cinder-quobyte-2d3dd459-b1c9-4c03-a6b1-01526004b681" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-2d3dd459-b1c9-4c03-a6b1-01526004b681" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[671975eb-d4d3-4a1a-ada4-e8d4029a3899]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:25 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 1073741824" returned: 0 in 0.825s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:25 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 Jul 03 17:35:25 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:25 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 Jul 03 17:35:25 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:26 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508" returned: 0 in 0.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.450s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:26 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Creating offline snapshot fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 of volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681" returned: 0 in 0.902s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79629f1-b6ba-4fee-8ac8-9c6ebf541ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c0f95e-ef43-426f-98cc-9fe1ee95b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc6de3-b79d-41ca-b5d6-1877db2a3123]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:26 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681 Jul 03 17:35:26 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Volume volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 (53bf58fc-5ce9-4681-a1fc-ee798bc43508): created successfully Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c0f95e-ef43-426f-98cc-9fe1ee95b218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Flow 'volume_create_manager' (f2a7cc48-21cb-4b0e-9be7-7fd7ef089239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:26 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-44b7e116-136a-42e9-a803-89e2b5153542 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Created volume successfully. Jul 03 17:35:26 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:26 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:26 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2d3dd459-b1c9-4c03-a6b1-01526004b681" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Lock "cinder-quobyte-2d3dd459-b1c9-4c03-a6b1-01526004b681" released by "delete_volume" :: held 1.668s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Created reservations ['edec8e4e-f0d2-497d-9240-6152673f8635', '68b4da39-795d-4900-84db-41e13f1b11dd', '970507b3-4372-478e-a77b-94a6af4119de', '9665b8f9-6aae-444b-8295-eaf83a4ece2c'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:26 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 0.840s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:27 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:27 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:27 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 1G Jul 03 17:35:27 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:27 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.708s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Deleted volume successfully. Jul 03 17:35:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-dba4bb68-3a36-417b-a337-943382efd7ca tempest-VolumesActionsTest-924391184 None] Lock "cinder-2d3dd459-b1c9-4c03-a6b1-01526004b681-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:28 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (1f688875-d5e9-4d1d-a03a-2e5d95dfb8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf88aab-7af3-47fe-8784-20f4ceeeb2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 1G" returned: 0 in 1.038s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf88aab-7af3-47fe-8784-20f4ceeeb2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483525066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8659bbc-742c-42de-8a37-421298797249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:28Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:28 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:28 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f237ba-20e1-4d07-875a-7d11dd8565db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f237ba-20e1-4d07-875a-7d11dd8565db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa7c2ba-c74d-49e2-a390-d6be85dc91f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa7c2ba-c74d-49e2-a390-d6be85dc91f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8659bbc-742c-42de-8a37-421298797249', 'volume_name': 'volume-d8659bbc-742c-42de-8a37-421298797249', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92e7ef0-6153-479a-b402-5cabd625df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92e7ef0-6153-479a-b402-5cabd625df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e47101-b58d-400d-83f0-ba79a4aa5c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Volume d8659bbc-742c-42de-8a37-421298797249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8659bbc-742c-42de-8a37-421298797249', 'volume_size': 1} Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:28 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 0.689s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:28 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 is being set with open permissions: ugo+rw Jul 03 17:35:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:28 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:28 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:29 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 0.762s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.471s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483525066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8659bbc-742c-42de-8a37-421298797249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfdd1289ef9447a8036091c7f04e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:28Z,use_quota=True,user_id='5bf982eca884447193dcdfc5934a21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Creating volume d8659bbc-742c-42de-8a37-421298797249 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:29 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:29 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 1073741824 Jul 03 17:35:29 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9bc9d7ba-5448-4f20-9f0b-589df82929bc tempest-VolumesSnapshotListTestJSON-1699998008 None] Create snapshot completed successfully Jul 03 17:35:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:30 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 1073741824" returned: 0 in 1.025s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:30 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 Jul 03 17:35:30 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:31 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.099s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e47101-b58d-400d-83f0-ba79a4aa5c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8659bbc-742c-42de-8a37-421298797249', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a32854-a42d-4e0a-ac18-9dd52053147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Creating offline snapshot cee51787-ca68-4788-9f5a-08fd9a0cd02b of volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:35:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Volume volume-d8659bbc-742c-42de-8a37-421298797249 (d8659bbc-742c-42de-8a37-421298797249): created successfully Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a32854-a42d-4e0a-ac18-9dd52053147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Flow 'volume_create_manager' (1f688875-d5e9-4d1d-a03a-2e5d95dfb8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a991ac7-610c-4553-a3c5-94f06fa44b4d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ad5f4e6b-0239-4534-b96d-0c0d87da606b tempest-VolumesActionsTest-2117153237 None] Created volume successfully. Jul 03 17:35:31 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:31 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:32 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:32 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b 1G Jul 03 17:35:32 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:32 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b 1G" returned: 0 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:33 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b Jul 03 17:35:33 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:33 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b" returned: 0 in 0.672s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:33 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b is being set with open permissions: ugo+rw Jul 03 17:35:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:33 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b Jul 03 17:35:33 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Acquiring lock "cinder-d8659bbc-742c-42de-8a37-421298797249-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Lock "cinder-d8659bbc-742c-42de-8a37-421298797249-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Acquiring lock "cinder-quobyte-d8659bbc-742c-42de-8a37-421298797249" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Lock "cinder-quobyte-d8659bbc-742c-42de-8a37-421298797249" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a07b12-a3a4-472e-8773-56eb6e87a2ab]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:34 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.078s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.044s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:34 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 Jul 03 17:35:34 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20845371-3f52-4a4c-ac9f-791708747446]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7e04e17c-e2cb-4d80-a1b5-405f7c812f98 tempest-VolumesSnapshotListTestJSON-1699998008 None] Create snapshot completed successfully Jul 03 17:35:34 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 Jul 03 17:35:34 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:35 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249" returned: 0 in 0.980s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:35 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249 Jul 03 17:35:35 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:35 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '294864c6-d827-485a-af99-feceec8db506', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:35:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-1d77b475-06d3-4a77-acca-d58a3dbbcd21 req-b8a34e5d-6132-4c31-af84-9184575c4fa6 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] attachment_update completed successfully. Jul 03 17:35:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-cee51787-ca68-4788-9f5a-08fd9a0cd02b-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-cee51787-ca68-4788-9f5a-08fd9a0cd02b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-cee51787-ca68-4788-9f5a-08fd9a0cd02b" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-cee51787-ca68-4788-9f5a-08fd9a0cd02b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Deleting offline snapshot cee51787-ca68-4788-9f5a-08fd9a0cd02b of volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] snapshot_file for this snap is: volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce7a698-3a74-4775-bcd9-a24241c59187]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d8659bbc-742c-42de-8a37-421298797249" returned: 0 in 0.938s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:36 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Lock "cinder-quobyte-d8659bbc-742c-42de-8a37-421298797249" released by "delete_volume" :: held 1.972s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Created reservations ['1a01ba66-830d-457e-95a2-cd30085b112d', '652fd9ce-5fbd-407f-a2c9-86ebd5d422f5', '27c87c8f-62b5-4cd7-b39a-763e0dfb3f91', 'e74bd5b7-e5f7-4d7d-b73f-000ebd60841e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:36 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b Jul 03 17:35:36 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:36 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:36 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:37 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b" returned: 0 in 1.083s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:37 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.900s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Deleted volume successfully. Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[889dceca-b5e0-4c7d-bc90-7ed986911209]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-33d76f99-be44-4ffd-88d4-435635532d5b tempest-VolumesActionsTest-2117153237 None] Lock "cinder-d8659bbc-742c-42de-8a37-421298797249-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:37 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:37 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:38 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 0.857s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:38 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b Jul 03 17:35:38 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:39 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b" returned: 0 in 0.917s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:39 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b Jul 03 17:35:39 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:39 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.cee51787-ca68-4788-9f5a-08fd9a0cd02b" returned: 0 in 0.790s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-cee51787-ca68-4788-9f5a-08fd9a0cd02b" released by "_delete_snapshot" :: held 3.805s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" released by "delete_snapshot" :: held 3.841s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Created reservations ['a819ef43-e06e-4817-bdaa-5d1a3ecb3370', '6a5ee5b5-cb90-401e-953f-9026286674fd', '3d982012-dc28-4baa-9437-02404b279a71', 'c6fb457a-e816-4fb0-96e1-d57565081762'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Delete snapshot completed successfully. Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-24713e2e-213b-4375-93d8-d26974b28003 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-cee51787-ca68-4788-9f5a-08fd9a0cd02b-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-fa41b60e-43fc-4fb2-90c8-d93d67ecdf98-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-fa41b60e-43fc-4fb2-90c8-d93d67ecdf98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Deleting offline snapshot fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 of volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] snapshot_file for this snap is: volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f5936-0d8a-4e95-aace-96d55ed4c42a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:40 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:40 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:41 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 1.046s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e148f6f0-47d6-457b-868c-aef9c5fdc21f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:41 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:41 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:42 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:42 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:42 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:43 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 1.022s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:43 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98 Jul 03 17:35:43 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:43 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:43 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-077b7cfa-6f24-4a2d-8793-36c136f0d71a req-9038a7e5-eb0d-48c2-9a72-f28d55ca248c tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Terminate volume connection completed successfully. Jul 03 17:35:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-077b7cfa-6f24-4a2d-8793-36c136f0d71a req-9038a7e5-eb0d-48c2-9a72-f28d55ca248c tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Deleting attachment 294864c6-d827-485a-af99-feceec8db506. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:35:44 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" returned: 0 in 0.896s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-fa41b60e-43fc-4fb2-90c8-d93d67ecdf98" released by "_delete_snapshot" :: held 4.038s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" released by "delete_snapshot" :: held 4.072s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Created reservations ['e011457d-1194-400b-ada5-9d573d1ea7af', 'c7d87b16-b354-4f7b-b114-22e50a37ca55', 'c134a262-6567-478c-9e79-a42049948828', '49174232-8b33-4812-96ba-aa925a5bf4a4'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Delete snapshot completed successfully. Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-35a14307-3452-4385-b11e-adf819993a18 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-fa41b60e-43fc-4fb2-90c8-d93d67ecdf98-delete_snapshot" released by "delete_snapshot" :: held 4.295s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:44 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.038s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:35:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Acquiring lock "cinder-53bf58fc-5ce9-4681-a1fc-ee798bc43508-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "cinder-53bf58fc-5ce9-4681-a1fc-ee798bc43508-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Acquiring lock "cinder-quobyte-53bf58fc-5ce9-4681-a1fc-ee798bc43508" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "cinder-quobyte-53bf58fc-5ce9-4681-a1fc-ee798bc43508" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[297705cc-9917-4c32-b2ae-7f4a2b1deae6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Deleting offline snapshot fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd of volume 9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] snapshot_file for this snap is: volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb75b1e-10a0-4cc0-be29-c2aa6bd7ad93]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:45 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 Jul 03 17:35:45 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:46 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:46 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:46 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508" returned: 0 in 0.960s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:46 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508 Jul 03 17:35:46 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:46 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 0.999s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9302d56a-242a-473a-bc78-c63489dfa3e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:35:46 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c885a9-2ec4-4c3e-90ec-624bb225efd7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:47 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 Jul 03 17:35:47 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:47 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-53bf58fc-5ce9-4681-a1fc-ee798bc43508" returned: 0 in 0.822s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "cinder-quobyte-53bf58fc-5ce9-4681-a1fc-ee798bc43508" released by "delete_volume" :: held 1.842s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Created reservations ['7470e4a1-d9e1-4b2c-9e34-b11370b508eb', '2d50244b-b022-4739-80cb-4f8252af9052', '1a754e40-f734-4b7c-87f7-a6bf9f2d9bf4', '67a9d829-7260-4010-bed5-42c7b8fdf30d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:47 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:47 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:47 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8" returned: 0 in 1.014s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:47 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:47 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:48 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.938s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:48 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Deleted volume successfully. Jul 03 17:35:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d3e18a10-c555-4ec2-b373-391ec3b3e430 tempest-TestServerVolumeAttachScenarioOldVersion-1754619942 None] Lock "cinder-53bf58fc-5ce9-4681-a1fc-ee798bc43508-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:48 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 1.028s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:48 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd Jul 03 17:35:48 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Flow 'volume_create_manager' (f60904cb-b16a-4326-8e72-4b21fc3d954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b4c4a4-ddbb-4a42-a139-79134c7ea9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8.fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" returned: 0 in 1.150s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b4c4a4-ddbb-4a42-a139-79134c7ea9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-651207233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01d76c0-a6a4-4dcd-a6e6-81495c62db42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bcf7fd6a9d43e1a8179cf843484fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:50Z,use_quota=True,user_id='49f9f8af41024f0badeb2d5104c4ecfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd89848-9feb-4a06-ab22-1b881c455772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd89848-9feb-4a06-ab22-1b881c455772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae522e-dbfd-4f42-a3e8-f51fd30454f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae522e-dbfd-4f42-a3e8-f51fd30454f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01d76c0-a6a4-4dcd-a6e6-81495c62db42', 'volume_name': 'volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b3730f-7e26-48ae-ae81-df296f1cff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b3730f-7e26-48ae-ae81-df296f1cff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44653c84-5600-4ce2-b476-cf9d71a050fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Volume e01d76c0-a6a4-4dcd-a6e6-81495c62db42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42', 'volume_size': 1} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-651207233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01d76c0-a6a4-4dcd-a6e6-81495c62db42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bcf7fd6a9d43e1a8179cf843484fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:50Z,use_quota=True,user_id='49f9f8af41024f0badeb2d5104c4ecfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Creating volume e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:50 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:50 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 1073741824 Jul 03 17:35:50 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd" released by "_delete_snapshot" :: held 4.421s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" released by "delete_snapshot" :: held 4.454s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Flow 'volume_create_manager' (61f9e215-51a4-4944-a7c3-d43262270dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec8c18e-0baf-4fbc-897e-a55a2b110d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec8c18e-0baf-4fbc-897e-a55a2b110d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-573718790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b47f997-5616-457a-b16e-d3dd8ae21a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46df0484dd094aa9896fab9bac0e0cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:50Z,use_quota=True,user_id='b619545a8c0e4fdc8a5bb854fa7d107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6aa63e-6738-4855-99a7-e7511b8d8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6aa63e-6738-4855-99a7-e7511b8d8397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c2fb9b-c45c-4e93-a805-96f2c4a4982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c2fb9b-c45c-4e93-a805-96f2c4a4982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b47f997-5616-457a-b16e-d3dd8ae21a49', 'volume_name': 'volume-3b47f997-5616-457a-b16e-d3dd8ae21a49', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5e677c-5477-4d7e-8407-f85b61430a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5e677c-5477-4d7e-8407-f85b61430a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3deef7e-3a77-428e-9ffe-aa4221ea57c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:50 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Volume 3b47f997-5616-457a-b16e-d3dd8ae21a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b47f997-5616-457a-b16e-d3dd8ae21a49', 'volume_size': 1} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Created reservations ['01821be4-fd53-46e7-9a13-be3d7d102064', 'c790da6e-3dcb-42ce-ae76-3ddcd459dcb6', 'a10ae017-fc0f-48c1-a4fc-f4c6811b3f53', '923a0769-42ef-4dfa-9bba-3c86eca1e7bb'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Delete snapshot completed successfully. Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d451a8cc-e214-4170-a739-6ffb4c11c417 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-fadd0a96-7050-48a7-8f34-dc7bc4cd6bfd-delete_snapshot" released by "delete_snapshot" :: held 4.673s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-9302d56a-242a-473a-bc78-c63489dfa3e8-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-9302d56a-242a-473a-bc78-c63489dfa3e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=119,cinder:INSERT=33,cinder:UPDATE=139,cinder:DELETE=9 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:35:50 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=112,cinder:UPDATE=142,cinder:DELETE=13,cinder:INSERT=39 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:35:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f01929b-bbbc-45f0-893b-d283684ef2e6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:51 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 1073741824" returned: 0 in 1.047s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:51 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 Jul 03 17:35:51 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:51 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 Jul 03 17:35:51 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:52 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" returned: 0 in 0.789s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:52 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-573718790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b47f997-5616-457a-b16e-d3dd8ae21a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46df0484dd094aa9896fab9bac0e0cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:50Z,use_quota=True,user_id='b619545a8c0e4fdc8a5bb854fa7d107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Creating volume 3b47f997-5616-457a-b16e-d3dd8ae21a49 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:52 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8" returned: 0 in 1.037s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:52 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 1073741824 Jul 03 17:35:52 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44653c84-5600-4ce2-b476-cf9d71a050fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3c6a37-9ec7-4c9b-95eb-e1f594a004ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:52 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8 Jul 03 17:35:52 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:52 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Volume volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 (e01d76c0-a6a4-4dcd-a6e6-81495c62db42): created successfully Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3c6a37-9ec7-4c9b-95eb-e1f594a004ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Flow 'volume_create_manager' (f60904cb-b16a-4326-8e72-4b21fc3d954d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a4e7a689-5fb3-44ff-acd2-ac77f1ccf520 tempest-SnapshotMetadataTestJSON-1027794088 None] Created volume successfully. Jul 03 17:35:52 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9302d56a-242a-473a-bc78-c63489dfa3e8" returned: 0 in 0.664s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-quobyte-9302d56a-242a-473a-bc78-c63489dfa3e8" released by "delete_volume" :: held 1.785s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Created reservations ['032d7db3-4e4f-43c7-bd60-39b0d3e4afe4', 'fb6e5a83-f0a3-4055-8ea5-69f478413031', 'f5ea1787-7bd7-4624-8a17-6e02b630f439', 'e02f36a0-a5fe-4bfd-8d12-89bc9515b6d3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:52 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:52 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:52 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 1073741824" returned: 0 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:53 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 Jul 03 17:35:53 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:53 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.815s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Deleted volume successfully. Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1225033b-b3e5-4d2a-bdb5-c0b0382a7695 tempest-VolumesSnapshotListTestJSON-1699998008 None] Lock "cinder-9302d56a-242a-473a-bc78-c63489dfa3e8-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:53 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49" returned: 0 in 0.873s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Creating offline snapshot 2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e of volume e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3deef7e-3a77-428e-9ffe-aa4221ea57c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b47f997-5616-457a-b16e-d3dd8ae21a49', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1385409c-3da9-42fe-9917-1297ef9db69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca435622-560e-4205-bf05-0f9d9c09870e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:53 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Volume volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 (3b47f997-5616-457a-b16e-d3dd8ae21a49): created successfully Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1385409c-3da9-42fe-9917-1297ef9db69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Flow 'volume_create_manager' (61f9e215-51a4-4944-a7c3-d43262270dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5176faf9-51fa-40c5-b4c5-318d7e390ebc tempest-VolumeQuotasAdminTestJSON-1540306301 None] Created volume successfully. Jul 03 17:35:54 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 Jul 03 17:35:54 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "cinder-3b47f997-5616-457a-b16e-d3dd8ae21a49-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "cinder-3b47f997-5616-457a-b16e-d3dd8ae21a49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "cinder-quobyte-3b47f997-5616-457a-b16e-d3dd8ae21a49" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "cinder-quobyte-3b47f997-5616-457a-b16e-d3dd8ae21a49" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[714d6b5b-e0a9-4e35-8c04-3dc29e45caca]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:54 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 Jul 03 17:35:54 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:54 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" returned: 0 in 0.880s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:54 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e 1G Jul 03 17:35:54 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:55 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49" returned: 0 in 0.900s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:55 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49 Jul 03 17:35:55 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:55 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e 1G" returned: 0 in 0.879s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:55 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e Jul 03 17:35:55 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:56 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3b47f997-5616-457a-b16e-d3dd8ae21a49" returned: 0 in 0.786s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "cinder-quobyte-3b47f997-5616-457a-b16e-d3dd8ae21a49" released by "delete_volume" :: held 1.740s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:56 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" returned: 0 in 0.779s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:56 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e is being set with open permissions: ugo+rw Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Created reservations ['edcd7b83-242d-4363-8ab9-e82465a69a3e', 'b0b73ce0-a569-40f6-ac94-788f882a245a', '6a94734c-b4fa-46a3-8d4c-d0e000980dbd', 'd6e42831-8675-4a45-ac4a-0dd92f8be2cb'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:35:56 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e Jul 03 17:35:56 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:56 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:35:56 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:57 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" returned: 0 in 0.794s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:57 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info Jul 03 17:35:57 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Flow 'volume_create_manager' (f656dbae-87c4-4ecb-90c7-e596a4f555d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94965b6c-903c-477f-8f2b-0d28ab399f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94965b6c-903c-477f-8f2b-0d28ab399f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-52877369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7631800b-25d7-4ad6-8609-0f52e9dd1078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46df0484dd094aa9896fab9bac0e0cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:58Z,use_quota=True,user_id='b619545a8c0e4fdc8a5bb854fa7d107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fc2413-4c22-4868-9321-a8dee2c4b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fc2413-4c22-4868-9321-a8dee2c4b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ad4cd5-dd4e-414b-94ca-7300e5b7df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ad4cd5-dd4e-414b-94ca-7300e5b7df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7631800b-25d7-4ad6-8609-0f52e9dd1078', 'volume_name': 'volume-7631800b-25d7-4ad6-8609-0f52e9dd1078', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5464be44-c109-4b13-9112-0b76957da861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5464be44-c109-4b13-9112-0b76957da861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432b5e29-65ea-4fd4-82bf-a24f2ac144ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:35:57 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Volume 7631800b-25d7-4ad6-8609-0f52e9dd1078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7631800b-25d7-4ad6-8609-0f52e9dd1078', 'volume_size': 1} Jul 03 17:35:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:58 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.447s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:58 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:35:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Deleted volume successfully. Jul 03 17:35:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-47ff0fc7-fec2-47f3-87a7-6eeff388a5dd tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "cinder-3b47f997-5616-457a-b16e-d3dd8ae21a49-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:35:58 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info" returned: 0 in 1.150s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:58 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info is being set with open permissions: ugo+rw Jul 03 17:35:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:58 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info Jul 03 17:35:58 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:59 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.info" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.414s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-52877369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7631800b-25d7-4ad6-8609-0f52e9dd1078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46df0484dd094aa9896fab9bac0e0cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:35:58Z,use_quota=True,user_id='b619545a8c0e4fdc8a5bb854fa7d107d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Creating volume 7631800b-25d7-4ad6-8609-0f52e9dd1078 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:35:59 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:35:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:35:59 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 1073741824 Jul 03 17:35:59 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:35:59 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6612ffe5-288e-4ea2-9b0f-da0e65001f7b tempest-SnapshotMetadataTestJSON-1027794088 None] Create snapshot completed successfully Jul 03 17:36:00 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 1073741824" returned: 0 in 1.030s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:00 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 Jul 03 17:36:00 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "cinder-2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "cinder-quobyte-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-quobyte-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "cinder-quobyte-2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-quobyte-2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Deleting offline snapshot 2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e of volume e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] snapshot_file for this snap is: volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ea61c8-fb57-40a6-b0ca-9e82ed773d14]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:00 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e Jul 03 17:36:00 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:01 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078" returned: 0 in 0.902s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432b5e29-65ea-4fd4-82bf-a24f2ac144ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7631800b-25d7-4ad6-8609-0f52e9dd1078', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8c9e8d-8add-4983-820f-c3e0c42d7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:01 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Volume volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 (7631800b-25d7-4ad6-8609-0f52e9dd1078): created successfully Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8c9e8d-8add-4983-820f-c3e0c42d7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Flow 'volume_create_manager' (f656dbae-87c4-4ecb-90c7-e596a4f555d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6df937bd-e12e-4c8d-9860-44527e3ae0df tempest-VolumeQuotasAdminTestJSON-1540306301 None] Created volume successfully. Jul 03 17:36:01 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" returned: 0 in 0.961s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[182cbf8e-374f-4ca0-b7ec-0fe09eb6afa0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:01 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 Jul 03 17:36:01 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:02 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" returned: 0 in 1.212s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:03 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e Jul 03 17:36:03 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8ab9ffb3-1483-451f-ac75-162c0eeede11 tempest-VolumeQuotasAdminTestJSON-1049118638 None] Transfer volume completed successfully. Jul 03 17:36:03 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" returned: 0 in 0.890s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:03 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e Jul 03 17:36:03 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Acquiring lock "cinder-7631800b-25d7-4ad6-8609-0f52e9dd1078-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Lock "cinder-7631800b-25d7-4ad6-8609-0f52e9dd1078-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Acquiring lock "cinder-quobyte-7631800b-25d7-4ad6-8609-0f52e9dd1078" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Lock "cinder-quobyte-7631800b-25d7-4ad6-8609-0f52e9dd1078" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[25918120-666d-438c-946a-6f78139fd39a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:04 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 Jul 03 17:36:04 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:04 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42.2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" returned: 0 in 0.930s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-quobyte-2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e" released by "_delete_snapshot" :: held 4.201s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-quobyte-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" released by "delete_snapshot" :: held 4.238s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:05 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Created reservations ['ea4ce35c-b17a-4bd0-b941-53042d81ff95', '01343d29-b8da-4947-9ff8-14f410c7ce4d', 'e6d457d4-fa3a-4fee-9170-175824c31edb', 'd891a25d-d0ab-4985-8b26-958820f3bb8f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Delete snapshot completed successfully. Jul 03 17:36:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0da745f3-3d1d-422e-97bc-de93f8dcdb5b tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-2ae6bdeb-bdce-4f59-a2b4-ba604b1f2c7e-delete_snapshot" released by "delete_snapshot" :: held 4.500s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:05 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078" returned: 0 in 0.979s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:05 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078 Jul 03 17:36:05 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "cinder-e01d76c0-a6a4-4dcd-a6e6-81495c62db42-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-e01d76c0-a6a4-4dcd-a6e6-81495c62db42-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "cinder-quobyte-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-quobyte-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca2f02-1c26-4b96-868e-393e2f366dd3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:06 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7631800b-25d7-4ad6-8609-0f52e9dd1078" returned: 0 in 0.783s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Lock "cinder-quobyte-7631800b-25d7-4ad6-8609-0f52e9dd1078" released by "delete_volume" :: held 1.820s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Created reservations ['7c1c5cda-7427-4403-b539-a8cfb304733f', 'bd49bb6d-6877-44b6-b89d-7ebd65a1df07', '20faed07-9598-4ed1-96d8-8e8e41084af2', 'f02b8cb1-18e8-4ec8-9529-ecb809b0e6dd'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:06 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 Jul 03 17:36:06 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:06 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:06 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:07 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.836s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:07 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Deleted volume successfully. Jul 03 17:36:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a5a39cd-1b9d-48d5-8ede-adb741bbc638 tempest-VolumeQuotasAdminTestJSON-1338294841 None] Lock "cinder-7631800b-25d7-4ad6-8609-0f52e9dd1078-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:07 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" returned: 0 in 1.332s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:07 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42 Jul 03 17:36:07 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:08 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-quobyte-e01d76c0-a6a4-4dcd-a6e6-81495c62db42" released by "delete_volume" :: held 2.215s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Created reservations ['4848c55c-a4f4-4f8c-94b2-baff1dc4e468', '78f04ca8-3c28-45f7-94aa-40a48601f5bd', 'cab4adb4-cb8d-467a-b0ed-8758121c2a74', 'ad90aee3-f074-4c60-a4c4-33bf8f74d854'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:08 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:08 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:09 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:09 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Deleted volume successfully. Jul 03 17:36:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-328904b3-5ec8-45f8-90e3-452cbfda2216 tempest-SnapshotMetadataTestJSON-1027794088 None] Lock "cinder-e01d76c0-a6a4-4dcd-a6e6-81495c62db42-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Flow 'volume_create_manager' (50766e48-d46d-4d1a-a0cb-ed78413c59bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a874253-2738-430c-ad51-97682f69a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a874253-2738-430c-ad51-97682f69a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-514710100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03286ae3-823d-4d7d-a177-c8b617ab1802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2a405666aa4ce2ae023df69542ee2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:16Z,use_quota=True,user_id='7c0e4c7e3d0b45d3bbfc628343c65a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783459fb-6341-4fc3-b0a0-39da6c3d440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783459fb-6341-4fc3-b0a0-39da6c3d440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f70cf21-c5b4-4c99-ad6c-b4be1086d552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f70cf21-c5b4-4c99-ad6c-b4be1086d552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03286ae3-823d-4d7d-a177-c8b617ab1802', 'volume_name': 'volume-03286ae3-823d-4d7d-a177-c8b617ab1802', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fb2f5f-1df7-4f1f-8dd3-d167ee3159b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fb2f5f-1df7-4f1f-8dd3-d167ee3159b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf5f17e-15cf-482c-829d-a39e81ae5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Volume 03286ae3-823d-4d7d-a177-c8b617ab1802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03286ae3-823d-4d7d-a177-c8b617ab1802', 'volume_size': 1} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-514710100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03286ae3-823d-4d7d-a177-c8b617ab1802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2a405666aa4ce2ae023df69542ee2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:16Z,use_quota=True,user_id='7c0e4c7e3d0b45d3bbfc628343c65a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Creating volume 03286ae3-823d-4d7d-a177-c8b617ab1802 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:15 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:15 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 1073741824 Jul 03 17:36:15 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:17 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 1073741824" returned: 0 in 1.487s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:17 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 Jul 03 17:36:17 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:18 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802" returned: 0 in 1.021s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] <== create_volume: return (2586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf5f17e-15cf-482c-829d-a39e81ae5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03286ae3-823d-4d7d-a177-c8b617ab1802', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4522d6da-06fb-4d7c-a498-9962779bd3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Volume volume-03286ae3-823d-4d7d-a177-c8b617ab1802 (03286ae3-823d-4d7d-a177-c8b617ab1802): created successfully Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4522d6da-06fb-4d7c-a498-9962779bd3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Flow 'volume_create_manager' (50766e48-d46d-4d1a-a0cb-ed78413c59bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b93cd4b5-98d1-469e-a6ee-91deb2904d49 tempest-AbsoluteLimitsTests-1945062035 None] Created volume successfully. Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Flow 'volume_create_manager' (61de9fa3-943c-40d9-8538-ffd3498b0a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0734e510-d00d-4c45-bc44-34d849963564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0734e510-d00d-4c45-bc44-34d849963564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-268944116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3135b8-cda6-4c15-9cf2-20c80e228727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba41bf68bcf542b09be3607c5b5b65b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:19Z,use_quota=True,user_id='e57fd1def9114c7e83bdfe400fc5e187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17add510-5321-4dac-98d8-1454b6ab0511),volume_type_id=17add510-5321-4dac-98d8-1454b6ab0511)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c59dcc6-8503-44c5-b19f-686a02756a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c59dcc6-8503-44c5-b19f-686a02756a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9804887c-89bc-42cd-b2d5-34ab61945b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9804887c-89bc-42cd-b2d5-34ab61945b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3135b8-cda6-4c15-9cf2-20c80e228727', 'volume_name': 'volume-aa3135b8-cda6-4c15-9cf2-20c80e228727', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6876f961-2fe1-4227-8b8e-aae9fdfb2451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6876f961-2fe1-4227-8b8e-aae9fdfb2451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077c0a45-3838-41c9-a953-b1c68393a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Volume aa3135b8-cda6-4c15-9cf2-20c80e228727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3135b8-cda6-4c15-9cf2-20c80e228727', 'volume_size': 1} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-268944116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3135b8-cda6-4c15-9cf2-20c80e228727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba41bf68bcf542b09be3607c5b5b65b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:19Z,use_quota=True,user_id='e57fd1def9114c7e83bdfe400fc5e187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17add510-5321-4dac-98d8-1454b6ab0511),volume_type_id=17add510-5321-4dac-98d8-1454b6ab0511)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Creating volume aa3135b8-cda6-4c15-9cf2-20c80e228727 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:18 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:18 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 1073741824 Jul 03 17:36:18 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Acquiring lock "cinder-03286ae3-823d-4d7d-a177-c8b617ab1802-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Lock "cinder-03286ae3-823d-4d7d-a177-c8b617ab1802-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Acquiring lock "cinder-quobyte-03286ae3-823d-4d7d-a177-c8b617ab1802" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Lock "cinder-quobyte-03286ae3-823d-4d7d-a177-c8b617ab1802" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfac3b24-f7fc-4ca1-8cbb-499c3d9665d3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:19 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 Jul 03 17:36:19 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:20 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 1073741824" returned: 0 in 1.237s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:20 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 Jul 03 17:36:20 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:20 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802" returned: 0 in 1.274s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:20 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802 Jul 03 17:36:20 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:21 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727" returned: 0 in 1.100s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077c0a45-3838-41c9-a953-b1c68393a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3135b8-cda6-4c15-9cf2-20c80e228727', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d58038-5a3d-4789-b1b6-1678d6f5bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Volume volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 (aa3135b8-cda6-4c15-9cf2-20c80e228727): created successfully Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d58038-5a3d-4789-b1b6-1678d6f5bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Flow 'volume_create_manager' (61de9fa3-943c-40d9-8538-ffd3498b0a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:21 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3871b696-78d8-4d20-ae1d-cd6198fe68d2 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Created volume successfully. Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:21 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Flow 'volume_create_manager' (635b9e84-5970-46e9-82e7-8b4782c6fbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527f0ed9-b9ec-46ae-a21a-d4c7257d4fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-03286ae3-823d-4d7d-a177-c8b617ab1802" returned: 0 in 0.842s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527f0ed9-b9ec-46ae-a21a-d4c7257d4fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90b5968-b1c8-426c-9bf5-8bd943f7c7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d796cfd966014d93820a8f5d61db121a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:22Z,use_quota=True,user_id='95388f2927654656908856f67924eed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d743f9dc-5689-4f76-b2dd-2970f2c94432),volume_type_id=d743f9dc-5689-4f76-b2dd-2970f2c94432)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b9072b-3ec4-40a3-8231-9954d13a0b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b9072b-3ec4-40a3-8231-9954d13a0b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46040c1-da74-4408-8a35-e0c426006e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Lock "cinder-quobyte-03286ae3-823d-4d7d-a177-c8b617ab1802" released by "delete_volume" :: held 2.227s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Created reservations ['804eaaad-5a27-45f4-aa24-0d615b7e5cbc', 'a5228c78-66f4-4c45-84b4-008397518289', '0aaa2a33-f308-454b-8666-22858ea0dc85', 'a7c52587-9980-4420-865a-b277a50195df'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:21 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:21 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46040c1-da74-4408-8a35-e0c426006e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b90b5968-b1c8-426c-9bf5-8bd943f7c7da', 'volume_name': 'volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da', 'volume_size': 1, 'image_id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7425830-fb60-406c-b7ef-47895d2d3fff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56ce979084d40e886cb21b73b4b43c7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd796cfd966014d93820a8f5d61db121a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '795d5fe90b83abc6279a5b398443dd19c482f86662d675075b223205bf83890205b16a2711a0cdc8410537921526129928ba414d8b6a188bb20c10a764442e47', 'id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'created_at': datetime.datetime(2026, 7, 3, 15, 36, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 36, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7425830-fb60-406c-b7ef-47895d2d3fff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ec4f21-7c46-47f1-9bde-20fa56271432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ec4f21-7c46-47f1-9bde-20fa56271432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6b44ef-aaed-446b-822d-3517ea901372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Volume b90b5968-b1c8-426c-9bf5-8bd943f7c7da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da', 'volume_size': 1, 'image_id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7425830-fb60-406c-b7ef-47895d2d3fff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56ce979084d40e886cb21b73b4b43c7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd796cfd966014d93820a8f5d61db121a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '795d5fe90b83abc6279a5b398443dd19c482f86662d675075b223205bf83890205b16a2711a0cdc8410537921526129928ba414d8b6a188bb20c10a764442e47', 'id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'created_at': datetime.datetime(2026, 7, 3, 15, 36, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 36, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7425830-fb60-406c-b7ef-47895d2d3fff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Trying to clone b90b5968-b1c8-426c-9bf5-8bd943f7c7da from image e7425830-fb60-406c-b7ef-47895d2d3fff at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7425830-fb60-406c-b7ef-47895d2d3fff', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:36:22 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Image download 0.00 MB at 0.00 MB/s Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba46c31-75bb-46bb-9f3c-86e2ae924ad4]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:22 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:22 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:22 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD Jul 03 17:36:22 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:22 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.991s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Deleted volume successfully. Jul 03 17:36:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c2a80755-7c7f-471f-924a-695765369e58 tempest-AbsoluteLimitsTests-1945062035 None] Lock "cinder-03286ae3-823d-4d7d-a177-c8b617ab1802-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:23 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8a2c2a89-9b10-4dc7-b2f3-29e77bbb6e41 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Retype volume completed successfully. Jul 03 17:36:23 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD" returned: 0 in 0.936s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:23 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD Jul 03 17:36:23 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Acquiring lock "cinder-aa3135b8-cda6-4c15-9cf2-20c80e228727-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "cinder-aa3135b8-cda6-4c15-9cf2-20c80e228727-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Acquiring lock "cinder-quobyte-aa3135b8-cda6-4c15-9cf2-20c80e228727" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "cinder-quobyte-aa3135b8-cda6-4c15-9cf2-20c80e228727" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbe6b9a-86be-4587-a269-1e7c227eafe3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:23 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 Jul 03 17:36:23 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:24 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD" returned: 1 in 1.030s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Temporary image e7425830-fb60-406c-b7ef-47895d2d3fff is fetched for user 95388f2927654656908856f67924eed7. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3311e-4f00-46b1-b5a9-106fb098f310]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:24 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD Jul 03 17:36:24 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:24 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727" returned: 0 in 0.905s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:24 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727 Jul 03 17:36:24 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:25 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:25 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD Jul 03 17:36:25 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:25 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-aa3135b8-cda6-4c15-9cf2-20c80e228727" returned: 0 in 0.918s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "cinder-quobyte-aa3135b8-cda6-4c15-9cf2-20c80e228727" released by "delete_volume" :: held 1.883s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Flow 'volume_create_manager' (c829aa0f-253c-4f1c-bb01-3254063a4cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d237a9ed-112e-4640-b253-c982d4d330a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:25 devstack cinder-volume[86621]: WARNING cinder.quota [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:36:25 devstack cinder-volume[86621]: WARNING cinder.quota [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d237a9ed-112e-4640-b253-c982d4d330a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-464869218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7ed684-b9fd-4858-9155-871418868f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681bf7372c7448459b7bbafdc4c955c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:26Z,use_quota=True,user_id='0dbd5552925b4a7fa443844f6835fa70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b896149-9e76-4832-a747-7d98d5184dec),volume_type_id=6b896149-9e76-4832-a747-7d98d5184dec)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb47cc4-1c1f-4b13-997e-5508d268c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb47cc4-1c1f-4b13-997e-5508d268c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24dca5fb-7307-406b-847c-a15643358b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24dca5fb-7307-406b-847c-a15643358b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7ed684-b9fd-4858-9155-871418868f75', 'volume_name': 'volume-8b7ed684-b9fd-4858-9155-871418868f75', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f450338-0f5d-43fb-9ae8-1e1c989ae779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f450338-0f5d-43fb-9ae8-1e1c989ae779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a0ebaf-0ed0-46ec-a383-8530d6eb2b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:25 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume 8b7ed684-b9fd-4858-9155-871418868f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7ed684-b9fd-4858-9155-871418868f75', 'volume_size': 1} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-464869218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7ed684-b9fd-4858-9155-871418868f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681bf7372c7448459b7bbafdc4c955c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:26Z,use_quota=True,user_id='0dbd5552925b4a7fa443844f6835fa70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b896149-9e76-4832-a747-7d98d5184dec),volume_type_id=6b896149-9e76-4832-a747-7d98d5184dec)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Creating volume 8b7ed684-b9fd-4858-9155-871418868f75 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:25 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:25 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 1073741824 Jul 03 17:36:25 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Created reservations ['2defe432-38e3-4df9-88fe-472cfd4f46b6', '7670b71a-832e-4f14-bd57-b8a4bddd3898', '3ed2ca74-0cd0-42f8-be9f-661e21f1437c', '854de28d-9ed6-42ad-9de0-bb8629d58b72'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:26 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:26 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:26 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD" returned: 1 in 0.983s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Flow 'volume_create_manager' (a6acadce-ca53-4d34-bc0e-2e684d639863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe224f0-f967-445a-9879-0cbb2970feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe224f0-f967-445a-9879-0cbb2970feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-148252959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954ea081-bf67-40cf-95cb-d6ab081ab514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681bf7372c7448459b7bbafdc4c955c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:26Z,use_quota=True,user_id='0dbd5552925b4a7fa443844f6835fa70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(863de6d3-80b5-44f6-826a-8968cb3cf212),volume_type_id=863de6d3-80b5-44f6-826a-8968cb3cf212)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b708004-c3e2-4b73-a3b0-26eb700df821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b708004-c3e2-4b73-a3b0-26eb700df821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7673bab4-9ab8-4469-abfb-d6e10de99bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7673bab4-9ab8-4469-abfb-d6e10de99bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954ea081-bf67-40cf-95cb-d6ab081ab514', 'volume_name': 'volume-954ea081-bf67-40cf-95cb-d6ab081ab514', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2fb816-6597-4094-a22d-227bdd4248a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2fb816-6597-4094-a22d-227bdd4248a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0573f9a9-07e4-4e81-850e-7fcae94980ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume 954ea081-bf67-40cf-95cb-d6ab081ab514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954ea081-bf67-40cf-95cb-d6ab081ab514', 'volume_size': 1} Jul 03 17:36:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:27 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Flow 'volume_create_manager' (86d8a115-8676-4ea8-86cf-66860616b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a459dcc-01bf-4c6a-b713-c163a0530754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.009s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a459dcc-01bf-4c6a-b713-c163a0530754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1113646409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34e50fb-c56c-447e-80e9-4bc10e20f67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681bf7372c7448459b7bbafdc4c955c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:27Z,use_quota=True,user_id='0dbd5552925b4a7fa443844f6835fa70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(034cee19-858d-4678-a985-1435789a3289),volume_type_id=034cee19-858d-4678-a985-1435789a3289)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d5a7a7-3e52-42df-9d59-1b312f096c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d5a7a7-3e52-42df-9d59-1b312f096c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5b32d6-86eb-4c95-912b-5074ef303a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:36:27 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Deleted volume successfully. Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 1073741824" returned: 0 in 1.355s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1e01c856-419d-42e2-a939-50a26ff953a4 tempest-VolumeRetypeWithoutMigrationTest-1764502225 None] Lock "cinder-aa3135b8-cda6-4c15-9cf2-20c80e228727-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:27 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 Jul 03 17:36:27 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5b32d6-86eb-4c95-912b-5074ef303a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a34e50fb-c56c-447e-80e9-4bc10e20f67f', 'volume_name': 'volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f', 'volume_size': 1, 'image_id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--574394874', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '681bf7372c7448459b7bbafdc4c955c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'created_at': datetime.datetime(2026, 7, 3, 15, 36, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 36, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d/file', 'properties': {}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b4f3b6-a5bc-45e3-87bd-a00bf6ad6e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b4f3b6-a5bc-45e3-87bd-a00bf6ad6e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d28599-c677-42d4-8bc9-85a81e5802f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:27 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume a34e50fb-c56c-447e-80e9-4bc10e20f67f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f', 'volume_size': 1, 'image_id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--574394874', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '681bf7372c7448459b7bbafdc4c955c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'created_at': datetime.datetime(2026, 7, 3, 15, 36, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 36, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d/file', 'properties': {}}, 'image_service': } Jul 03 17:36:27 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Trying to clone a34e50fb-c56c-447e-80e9-4bc10e20f67f from image c95c0c60-c704-4e95-a8ea-f7e79602a88d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:36:28 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75" returned: 0 in 0.799s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90b5968-b1c8-426c-9bf5-8bd943f7c7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d796cfd966014d93820a8f5d61db121a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:22Z,use_quota=True,user_id='95388f2927654656908856f67924eed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d743f9dc-5689-4f76-b2dd-2970f2c94432),volume_type_id=d743f9dc-5689-4f76-b2dd-2970f2c94432)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Creating volume b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:28 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:28 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da 1073741824 Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a0ebaf-0ed0-46ec-a383-8530d6eb2b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7ed684-b9fd-4858-9155-871418868f75', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:28 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466a74a9-5bb6-4d29-ba67-7b2c197283a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume volume-8b7ed684-b9fd-4858-9155-871418868f75 (8b7ed684-b9fd-4858-9155-871418868f75): created successfully Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466a74a9-5bb6-4d29-ba67-7b2c197283a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Flow 'volume_create_manager' (c829aa0f-253c-4f1c-bb01-3254063a4cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-070c01a7-1946-4866-9dfd-4f6a5077e958 tempest-TestInstancesWithCinderVolumes-1725704358 None] Created volume successfully. Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Flow 'volume_create_manager' (5d50c928-adbf-476f-8f51-84079e1a93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c7b050-443e-4083-8747-97b1e1023589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c7b050-443e-4083-8747-97b1e1023589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1614784689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86055016-6018-408b-8ee5-2ef13bc6d542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fca7b0d33642e88fc144872d748457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:29Z,use_quota=True,user_id='3b9ee2e8c6254f2a9cde1065e9640602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddc9c3e-2450-492b-9cdc-79a7cc81e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddc9c3e-2450-492b-9cdc-79a7cc81e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e37663c-81bc-405b-b6e0-84f7333166e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e37663c-81bc-405b-b6e0-84f7333166e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86055016-6018-408b-8ee5-2ef13bc6d542', 'volume_name': 'volume-86055016-6018-408b-8ee5-2ef13bc6d542', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:29 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56a5561-5902-4ae1-a8f8-d8c476a2ea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56a5561-5902-4ae1-a8f8-d8c476a2ea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a539c3-de3f-40e3-bc30-c2fa814e78fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:29 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Volume 86055016-6018-408b-8ee5-2ef13bc6d542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86055016-6018-408b-8ee5-2ef13bc6d542', 'volume_size': 1} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da 1073741824" returned: 0 in 0.983s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:29 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:29 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:29 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 0 in 0.669s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-148252959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954ea081-bf67-40cf-95cb-d6ab081ab514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681bf7372c7448459b7bbafdc4c955c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:26Z,use_quota=True,user_id='0dbd5552925b4a7fa443844f6835fa70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(863de6d3-80b5-44f6-826a-8968cb3cf212),volume_type_id=863de6d3-80b5-44f6-826a-8968cb3cf212)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Creating volume 954ea081-bf67-40cf-95cb-d6ab081ab514 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:29 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:29 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 1073741824 Jul 03 17:36:29 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Attempting download of e7425830-fb60-406c-b7ef-47895d2d3fff ((None, [{'url': 'file:///opt/stack/data/glance/images/e7425830-fb60-406c-b7ef-47895d2d3fff', 'metadata': {}}])) to volume b90b5968-b1c8-426c-9bf5-8bd943f7c7da. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[835d553a-2182-4d6d-8fcc-a7a5f65480b9]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:30 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw Jul 03 17:36:30 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:30 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 1073741824" returned: 0 in 0.983s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:30 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw" returned: 0 in 0.910s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:30 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 Jul 03 17:36:30 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:31 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw Jul 03 17:36:31 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:31 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw" returned: 1 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7425830-fb60-406c-b7ef-47895d2d3fff__928_8iw' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb835cc2-a819-454a-a802-454fac395e2f]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD, size 20.69 MB, duration 3.91 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:36:31 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Image download 20.69 MB at 5.29 MB/s Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a89e02-2720-41ab-b61a-800d45a1895a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:31 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514" returned: 0 in 0.851s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.698s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1614784689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86055016-6018-408b-8ee5-2ef13bc6d542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fca7b0d33642e88fc144872d748457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:29Z,use_quota=True,user_id='3b9ee2e8c6254f2a9cde1065e9640602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Creating volume 86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:31 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:31 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD Jul 03 17:36:31 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0573f9a9-07e4-4e81-850e-7fcae94980ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954ea081-bf67-40cf-95cb-d6ab081ab514', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:31 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 1073741824 Jul 03 17:36:31 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6aa293-739e-4f70-a90f-75d8f4c70700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume volume-954ea081-bf67-40cf-95cb-d6ab081ab514 (954ea081-bf67-40cf-95cb-d6ab081ab514): created successfully Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6aa293-739e-4f70-a90f-75d8f4c70700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Flow 'volume_create_manager' (a6acadce-ca53-4d34-bc0e-2e684d639863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-34243705-1505-4856-a0a6-7d61fb376b5c tempest-TestInstancesWithCinderVolumes-1725704358 None] Created volume successfully. Jul 03 17:36:31 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD Jul 03 17:36:31 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:32 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:32 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Temporary image c95c0c60-c704-4e95-a8ea-f7e79602a88d is fetched for user 0dbd5552925b4a7fa443844f6835fa70. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:36:32 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD Jul 03 17:36:32 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ccb062-8987-4d29-8885-febccdd21cce]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:32 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 1073741824" returned: 0 in 1.064s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:32 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD Jul 03 17:36:32 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:32 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:36:32 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:33 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD" returned: 1 in 0.797s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] e7425830-fb60-406c-b7ef-47895d2d3fff was raw, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:33 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:33 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:33 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:33 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 0.862s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1113646409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34e50fb-c56c-447e-80e9-4bc10e20f67f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681bf7372c7448459b7bbafdc4c955c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:27Z,use_quota=True,user_id='0dbd5552925b4a7fa443844f6835fa70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(034cee19-858d-4678-a985-1435789a3289),volume_type_id=034cee19-858d-4678-a985-1435789a3289)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Creating volume a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:33 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:33 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f 1073741824 Jul 03 17:36:33 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a539c3-de3f-40e3-bc30-c2fa814e78fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86055016-6018-408b-8ee5-2ef13bc6d542', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c301fc33-e177-4c2d-a9ef-ac34d553d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Flow 'volume_create_manager' (192f90d7-cdc0-42f9-ba27-7a4f97d2d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1859966-e363-4798-9f94-7b8a12d3ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Volume volume-86055016-6018-408b-8ee5-2ef13bc6d542 (86055016-6018-408b-8ee5-2ef13bc6d542): created successfully Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c301fc33-e177-4c2d-a9ef-ac34d553d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Flow 'volume_create_manager' (5d50c928-adbf-476f-8f51-84079e1a93b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1859966-e363-4798-9f94-7b8a12d3ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1953577171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01cfd6d-42e9-4f21-aa70-60e387c6a78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8ee554eeb94dbaa1e5988f15a4a290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:34Z,use_quota=True,user_id='01d8cf76e92a4a76a2d238b6ab4adc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628dd65c-74ab-4033-9cff-048a2ac8342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628dd65c-74ab-4033-9cff-048a2ac8342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82360f83-c2e4-4a2e-be83-7614e31242ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82360f83-c2e4-4a2e-be83-7614e31242ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01cfd6d-42e9-4f21-aa70-60e387c6a78f', 'volume_name': 'volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fa488e-a103-4076-a4a9-b067334d6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fa488e-a103-4076-a4a9-b067334d6580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61935f17-ec9a-45fa-9834-f71c4e9e85eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Volume a01cfd6d-42e9-4f21-aa70-60e387c6a78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f', 'volume_size': 1} Jul 03 17:36:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-49a82085-142d-40e0-902a-a14dd3f2e88a tempest-VolumesCloneTest-33612493 None] Created volume successfully. Jul 03 17:36:34 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 0 in 0.879s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7425830-fb60-406c-b7ef-47895d2d3fff_x1du_qfjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:36:34 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:34 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da 1G Jul 03 17:36:34 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:34 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f 1073741824" returned: 0 in 0.898s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:34 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:36:34 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Flow 'volume_create_manager' (2280328a-cb6c-4d26-95f4-30d8f50e8fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b5d78-eda1-4d61-97a0-37432d9527c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b5d78-eda1-4d61-97a0-37432d9527c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1347441413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bedee22-6ecf-4fc0-976d-e2f52630bac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fca7b0d33642e88fc144872d748457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=86055016-6018-408b-8ee5-2ef13bc6d542,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:35Z,use_quota=True,user_id='3b9ee2e8c6254f2a9cde1065e9640602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2799b13-2f1e-46de-9eb5-88f31f815617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2799b13-2f1e-46de-9eb5-88f31f815617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8bd413-a411-4fc7-bc1f-61513fcee805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:34 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8bd413-a411-4fc7-bc1f-61513fcee805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2bedee22-6ecf-4fc0-976d-e2f52630bac5', 'volume_name': 'volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5', 'volume_size': 2, 'source_volid': '86055016-6018-408b-8ee5-2ef13bc6d542', 'source_volstatus': 'available'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f680e0eb-fa92-400d-ab75-bd9019d81b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f680e0eb-fa92-400d-ab75-bd9019d81b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808c407-d27d-46ca-8ba0-693e9bde5e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:35 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Volume 2bedee22-6ecf-4fc0-976d-e2f52630bac5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5', 'volume_size': 2, 'source_volid': '86055016-6018-408b-8ee5-2ef13bc6d542', 'source_volstatus': 'available'} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da 1G" returned: 0 in 0.775s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808ed96-78d4-476e-9f60-48a7df6a656b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:35 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:35 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:35 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 0 in 0.666s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1953577171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01cfd6d-42e9-4f21-aa70-60e387c6a78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8ee554eeb94dbaa1e5988f15a4a290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:34Z,use_quota=True,user_id='01d8cf76e92a4a76a2d238b6ab4adc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Creating volume a01cfd6d-42e9-4f21-aa70-60e387c6a78f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:35 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:35 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f 1073741824 Jul 03 17:36:35 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Attempting download of c95c0c60-c704-4e95-a8ea-f7e79602a88d ((None, [{'url': 'file:///opt/stack/data/glance/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'metadata': {}}])) to volume a34e50fb-c56c-447e-80e9-4bc10e20f67f. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8365aac5-005b-4276-9c87-9a7fba44d014]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_ {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:35 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_ Jul 03 17:36:35 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:35 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:35 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:35 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:36 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_" returned: 0 in 0.789s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_ {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:36 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f 1073741824" returned: 0 in 0.883s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:36 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f Jul 03 17:36:36 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:36 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_ Jul 03 17:36:36 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:36 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 1 in 0.780s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Downloaded image e7425830-fb60-406c-b7ef-47895d2d3fff ((None, [{'url': 'file:///opt/stack/data/glance/images/e7425830-fb60-406c-b7ef-47895d2d3fff', 'metadata': {}}])) to volume b90b5968-b1c8-426c-9bf5-8bd943f7c7da successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Temporary image e7425830-fb60-406c-b7ef-47895d2d3fff for user 95388f2927654656908856f67924eed7 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Marking volume b90b5968-b1c8-426c-9bf5-8bd943f7c7da as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Copying metadata from image e7425830-fb60-406c-b7ef-47895d2d3fff to b90b5968-b1c8-426c-9bf5-8bd943f7c7da. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Creating volume glance metadata for volume b90b5968-b1c8-426c-9bf5-8bd943f7c7da backed by image e7425830-fb60-406c-b7ef-47895d2d3fff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '56ce979084d40e886cb21b73b4b43c7f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6b44ef-aaed-446b-822d-3517ea901372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da', 'volume_size': 1, 'image_id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7425830-fb60-406c-b7ef-47895d2d3fff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56ce979084d40e886cb21b73b4b43c7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd796cfd966014d93820a8f5d61db121a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '795d5fe90b83abc6279a5b398443dd19c482f86662d675075b223205bf83890205b16a2711a0cdc8410537921526129928ba414d8b6a188bb20c10a764442e47', 'id': 'e7425830-fb60-406c-b7ef-47895d2d3fff', 'created_at': datetime.datetime(2026, 7, 3, 15, 36, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 36, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7425830-fb60-406c-b7ef-47895d2d3fff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09badb5-0a0f-4443-862b-0c37bce88f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Volume volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da (b90b5968-b1c8-426c-9bf5-8bd943f7c7da): created successfully Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09badb5-0a0f-4443-862b-0c37bce88f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Flow 'volume_create_manager' (635b9e84-5970-46e9-82e7-8b4782c6fbb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a5ad380-71ed-4f13-92c1-0be64829c5ea tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Created volume successfully. Jul 03 17:36:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Acquiring lock "cinder-b90b5968-b1c8-426c-9bf5-8bd943f7c7da-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "cinder-b90b5968-b1c8-426c-9bf5-8bd943f7c7da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:37 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f" returned: 0 in 0.666s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:37 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Cloning volume 86055016-6018-408b-8ee5-2ef13bc6d542 to volume 2bedee22-6ecf-4fc0-976d-e2f52630bac5 Jul 03 17:36:37 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_" returned: 1 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c95c0c60-c704-4e95-a8ea-f7e79602a88d_17k8d0f_' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12fd405-9a50-4508-8776-aec44d102054]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61935f17-ec9a-45fa-9834-f71c4e9e85eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38855e02-23aa-4a54-a4d4-f07c3b535f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Acquiring lock "cinder-quobyte-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:37 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Volume volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f (a01cfd6d-42e9-4f21-aa70-60e387c6a78f): created successfully Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38855e02-23aa-4a54-a4d4-f07c3b535f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Flow 'volume_create_manager' (192f90d7-cdc0-42f9-ba27-7a4f97d2d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "cinder-quobyte-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Creating offline snapshot d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa of volume 86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:36:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-75cd0f04-67c1-4f60-96c2-eacc0d51239e tempest-VolumesServicesTestJSON-1098524978 None] Created volume successfully. Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d0c8e3-bf74-461f-9e52-418ef3e6f681]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:37 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD Jul 03 17:36:37 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2da43a-7e4d-4868-9cad-2c42520d4918]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:37 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:36:37 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:37 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:37 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:37 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] c95c0c60-c704-4e95-a8ea-f7e79602a88d was qcow2, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:37 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:36:37 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:37 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 0.764s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:38 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa 1G Jul 03 17:36:38 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:38 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 0 in 0.791s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:38 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:38 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Acquiring lock "cinder-a01cfd6d-42e9-4f21-aa70-60e387c6a78f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Lock "cinder-a01cfd6d-42e9-4f21-aa70-60e387c6a78f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Acquiring lock "cinder-quobyte-a01cfd6d-42e9-4f21-aa70-60e387c6a78f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Lock "cinder-quobyte-a01cfd6d-42e9-4f21-aa70-60e387c6a78f" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cacd99b-9d9d-41be-a922-cbe3e750a123]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:38 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f Jul 03 17:36:38 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:38 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 1 in 0.876s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:38 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa 1G" returned: 0 in 0.935s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86055016-6018-408b-8ee5-2ef13bc6d542 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:38 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da Jul 03 17:36:38 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:38 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86055016-6018-408b-8ee5-2ef13bc6d542 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa Jul 03 17:36:38 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:39 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f" returned: 0 in 0.916s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:39 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f Jul 03 17:36:39 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:39 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86055016-6018-408b-8ee5-2ef13bc6d542 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" returned: 0 in 0.786s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:39 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa is being set with open permissions: ugo+rw Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:39 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa Jul 03 17:36:39 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:39 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "cinder-quobyte-b90b5968-b1c8-426c-9bf5-8bd943f7c7da" released by "delete_volume" :: held 2.606s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:39 devstack cinder-volume[86621]: WARNING cinder.quota [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:36:39 devstack cinder-volume[86621]: WARNING cinder.quota [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Created reservations ['1b7acbea-e3c9-439d-9b39-bb2ce01c1ad7', 'ae6b74b5-d5b1-47c3-a6e1-a40730be62f1', '41932776-b9cc-47e1-abba-38622a83e505', '07d4a69d-a4e2-44cb-90e0-ca9d4d3056b7'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:39 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 0 in 2.082s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c95c0c60-c704-4e95-a8ea-f7e79602a88d_5zjva8efdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:36:39 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Converted 112.00 MB image at 53.76 MB/s Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:39 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f 1G Jul 03 17:36:39 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:39 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:39 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:40 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a01cfd6d-42e9-4f21-aa70-60e387c6a78f" returned: 0 in 0.824s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Lock "cinder-quobyte-a01cfd6d-42e9-4f21-aa70-60e387c6a78f" released by "delete_volume" :: held 1.794s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Created reservations ['ebdafe43-53c9-4efd-9054-09e88fbd83fc', '43cef552-6624-494d-a401-a127ee77cfef', '3b9eb6a1-c06d-452d-bd42-13abd8138d76', '222534f4-d46c-4c8d-a32b-483ca4eba38b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:40 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:40 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:40 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" returned: 0 in 0.959s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:40 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:40 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.847s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:40 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Deleted volume successfully. Jul 03 17:36:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b2032da4-085a-4d31-9f61-4f0e288133b4 tempest-VolumeAndVolumeTypeFromImageTest-1968708187 None] Lock "cinder-b90b5968-b1c8-426c-9bf5-8bd943f7c7da-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:41 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f 1G" returned: 0 in 1.118s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3debd715-92ae-4387-8cf7-fd316ebcbfc0]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:41 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:36:41 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:41 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.848s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Deleted volume successfully. Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c6f62b6e-d058-46f2-a90f-7bbb8350f22e tempest-VolumesServicesTestJSON-1098524978 None] Lock "cinder-a01cfd6d-42e9-4f21-aa70-60e387c6a78f-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:41 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info" returned: 0 in 0.963s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:41 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info is being set with open permissions: ugo+rw Jul 03 17:36:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:41 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info Jul 03 17:36:41 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:42 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 0 in 0.883s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:42 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:36:42 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:42 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.info" returned: 0 in 0.919s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Acquiring lock "cinder-quobyte-2bedee22-6ecf-4fc0-976d-e2f52630bac5" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-2bedee22-6ecf-4fc0-976d-e2f52630bac5" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] snapshot: d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa, volume: 2bedee22-6ecf-4fc0-976d-e2f52630bac5, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc5a1ee-71b4-49bc-8720-226d8a743bee]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:42 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa Jul 03 17:36:42 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:43 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 1 in 1.004s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Downloaded image c95c0c60-c704-4e95-a8ea-f7e79602a88d ((None, [{'url': 'file:///opt/stack/data/glance/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'metadata': {}}])) to volume a34e50fb-c56c-447e-80e9-4bc10e20f67f successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Temporary image c95c0c60-c704-4e95-a8ea-f7e79602a88d for user 0dbd5552925b4a7fa443844f6835fa70 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Marking volume a34e50fb-c56c-447e-80e9-4bc10e20f67f as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Copying metadata from image c95c0c60-c704-4e95-a8ea-f7e79602a88d to a34e50fb-c56c-447e-80e9-4bc10e20f67f. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Creating volume glance metadata for volume a34e50fb-c56c-447e-80e9-4bc10e20f67f backed by image c95c0c60-c704-4e95-a8ea-f7e79602a88d with: {'image_id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'image_name': 'tempest-scenario-img--574394874', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d28599-c677-42d4-8bc9-85a81e5802f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f', 'volume_size': 1, 'image_id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--574394874', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '681bf7372c7448459b7bbafdc4c955c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c95c0c60-c704-4e95-a8ea-f7e79602a88d', 'created_at': datetime.datetime(2026, 7, 3, 15, 36, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 36, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c95c0c60-c704-4e95-a8ea-f7e79602a88d/file', 'properties': {}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183cad0b-e8cc-43cf-b218-919d3b760a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:43 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Volume volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f (a34e50fb-c56c-447e-80e9-4bc10e20f67f): created successfully Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183cad0b-e8cc-43cf-b218-919d3b760a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Flow 'volume_create_manager' (86d8a115-8676-4ea8-86cf-66860616b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4c094c3b-4e66-4e4f-824a-347cc5432fc4 tempest-TestInstancesWithCinderVolumes-1725704358 None] Created volume successfully. Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:43 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" returned: 0 in 1.055s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86055016-6018-408b-8ee5-2ef13bc6d542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:36:43 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:43 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c982eb3-1736-4a7b-bbc3-64e3ea968ae9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:43 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:36:43 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:44 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:36:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:36:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:36:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:36:45 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 1.201s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:45 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:36:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:45 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 Jul 03 17:36:45 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Flow 'volume_create_manager' (355a7ac9-8346-4157-8784-fe3b843dd268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3daea757-f9ac-4aa9-8e2c-257130e03d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3daea757-f9ac-4aa9-8e2c-257130e03d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174252993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bc0955-70af-446d-ab49-fdb1bdc107a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460cabe53af94e4b8063498f546d4c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:50Z,use_quota=True,user_id='a31fa6c4eac74c999758bde8d5d6678e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfff6ec0-c550-4a04-98ee-ece97ced0196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfff6ec0-c550-4a04-98ee-ece97ced0196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ccc8a4-1a26-46cc-8d3c-10546da45132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ccc8a4-1a26-46cc-8d3c-10546da45132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26bc0955-70af-446d-ab49-fdb1bdc107a4', 'volume_name': 'volume-26bc0955-70af-446d-ab49-fdb1bdc107a4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c252cd-9d24-4015-ba6d-89068b0b129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c252cd-9d24-4015-ba6d-89068b0b129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d875ed7d-85cd-48bc-960a-d1124e57bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:50 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Volume 26bc0955-70af-446d-ab49-fdb1bdc107a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26bc0955-70af-446d-ab49-fdb1bdc107a4', 'volume_size': 1} Jul 03 17:36:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:51 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5" returned: 0 in 6.548s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2037b731-0f3c-487e-aaf3-039bc86bb2ed]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:51 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:36:51 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:51 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=97,cinder:UPDATE=110,cinder:INSERT=31,cinder:DELETE=12 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:36:51 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=114,cinder:INSERT=38,cinder:DELETE=8,cinder:SELECT=91 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:36:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:52 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 1.160s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:52 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:36:52 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Converted 1024.00 MB image at 156.36 MB/s Jul 03 17:36:52 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 is being set with open permissions: ugo+rw Jul 03 17:36:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:52 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 Jul 03 17:36:52 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:53 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5" returned: 0 in 0.810s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-2bedee22-6ecf-4fc0-976d-e2f52630bac5" released by "_copy_volume_from_snapshot" :: held 10.943s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Acquiring lock "cinder-quobyte-d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Deleting offline snapshot d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa of volume 86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] snapshot_file for this snap is: volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[798ca913-550a-48be-960f-9241c67ad4d1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:53 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa Jul 03 17:36:53 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:54 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" returned: 0 in 0.874s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86055016-6018-408b-8ee5-2ef13bc6d542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:36:54 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c6b63-fc3a-4ac0-be7d-ba745e616b8b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:54 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:36:54 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:55 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 0.793s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:55 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa Jul 03 17:36:55 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:56 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" returned: 0 in 0.774s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:56 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa Jul 03 17:36:56 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:56 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542.d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" returned: 0 in 0.659s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-d61017fa-a8dd-4f14-9c7c-54c8ca6acdaa" released by "_delete_snapshot" :: held 3.195s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.878s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.418s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174252993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bc0955-70af-446d-ab49-fdb1bdc107a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460cabe53af94e4b8063498f546d4c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:36:50Z,use_quota=True,user_id='a31fa6c4eac74c999758bde8d5d6678e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Creating volume 26bc0955-70af-446d-ab49-fdb1bdc107a4 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:36:56 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:56 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 1073741824 Jul 03 17:36:56 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808c407-d27d-46ca-8ba0-693e9bde5e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5', 'volume_size': 2, 'source_volid': '86055016-6018-408b-8ee5-2ef13bc6d542', 'source_volstatus': 'available'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf563284-4334-4ee0-a66c-c0c2f88c35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:57 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Volume volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 (2bedee22-6ecf-4fc0-976d-e2f52630bac5): created successfully Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf563284-4334-4ee0-a66c-c0c2f88c35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Flow 'volume_create_manager' (2280328a-cb6c-4d26-95f4-30d8f50e8fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-34e6686d-af1f-46cd-bfc3-d932b4aab3d8 tempest-VolumesCloneTest-33612493 None] Created volume successfully. Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Acquiring lock "cinder-2bedee22-6ecf-4fc0-976d-e2f52630bac5-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Lock "cinder-2bedee22-6ecf-4fc0-976d-e2f52630bac5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Acquiring lock "cinder-quobyte-2bedee22-6ecf-4fc0-976d-e2f52630bac5" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-2bedee22-6ecf-4fc0-976d-e2f52630bac5" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a6e12-bd85-48e4-9628-b8b5e0b7d0f5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:57 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 Jul 03 17:36:57 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:57 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 1073741824" returned: 0 in 0.904s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:57 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 Jul 03 17:36:57 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:58 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5" returned: 0 in 0.885s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:58 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5 Jul 03 17:36:58 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:58 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4" returned: 0 in 0.734s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.713s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d875ed7d-85cd-48bc-960a-d1124e57bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bc0955-70af-446d-ab49-fdb1bdc107a4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee58072b-37f3-4f59-8066-aaf72fa3c06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:36:58 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Volume volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 (26bc0955-70af-446d-ab49-fdb1bdc107a4): created successfully Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee58072b-37f3-4f59-8066-aaf72fa3c06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Flow 'volume_create_manager' (355a7ac9-8346-4157-8784-fe3b843dd268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[094159dd-83db-4c0f-901e-6f3f1c577e03]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cd5c0abf-40b6-49fd-9d4a-9a9a0880ecc2 tempest-ProjectReaderTests-233390883 None] Created volume successfully. Jul 03 17:36:58 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:36:58 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:59 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2bedee22-6ecf-4fc0-976d-e2f52630bac5" returned: 0 in 0.720s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-2bedee22-6ecf-4fc0-976d-e2f52630bac5" released by "delete_volume" :: held 1.650s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Created reservations ['8b0b9acb-ddb6-4b3e-846b-7a8d4f6710e0', '461b1b17-ab07-4ca7-9915-648bd8a30f88', '0ef46dcf-15bf-4065-aeb5-6fd1667c3f53', 'bbde3660-65b6-4db8-9097-2e0c159859f5'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:59 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:36:59 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:59 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 0 in 0.872s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Acquiring lock "cinder-86055016-6018-408b-8ee5-2ef13bc6d542-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Lock "cinder-86055016-6018-408b-8ee5-2ef13bc6d542-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Acquiring lock "cinder-quobyte-86055016-6018-408b-8ee5-2ef13bc6d542" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-86055016-6018-408b-8ee5-2ef13bc6d542" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:36:59 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:36:59 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e7d64a-6778-4fe9-bbf6-b2216b9f38c6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:36:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:00 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:37:00 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:00 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.129s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Deleted volume successfully. Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f557d21f-805d-4dc1-a097-33499edd4db2 tempest-VolumesCloneTest-33612493 None] Lock "cinder-2bedee22-6ecf-4fc0-976d-e2f52630bac5-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Acquiring lock "cinder-26bc0955-70af-446d-ab49-fdb1bdc107a4-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Lock "cinder-26bc0955-70af-446d-ab49-fdb1bdc107a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Acquiring lock "cinder-quobyte-26bc0955-70af-446d-ab49-fdb1bdc107a4" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Lock "cinder-quobyte-26bc0955-70af-446d-ab49-fdb1bdc107a4" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f0ca3-e15f-432a-8edd-eb0ff06867dc]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:00 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 1 in 1.115s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.071s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0936097-d267-4c44-bb17-4130e43845c4', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:37:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-77183d39-430b-41fd-8019-bb8ee1584ba8 req-cabedbc2-3624-4203-b57a-1026d6e70248 tempest-TestInstancesWithCinderVolumes-1725704358 None] attachment_update completed successfully. Jul 03 17:37:00 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 Jul 03 17:37:00 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:00 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 1.112s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:00 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542 Jul 03 17:37:01 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:01 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4" returned: 0 in 0.866s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:01 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4 Jul 03 17:37:01 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:01 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-86055016-6018-408b-8ee5-2ef13bc6d542" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Lock "cinder-quobyte-86055016-6018-408b-8ee5-2ef13bc6d542" released by "delete_volume" :: held 1.969s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Created reservations ['d36f9d51-2729-41c9-a3d7-4d73a9178e2d', '8e214395-39f9-44bb-a18e-1ceb281353c6', 'd8a77b21-6dfd-4f49-94fd-ff2e6cb77191', '31697164-80d8-4b6d-ba18-6d6f97fafb8d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:01 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:01 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:02 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-26bc0955-70af-446d-ab49-fdb1bdc107a4" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Lock "cinder-quobyte-26bc0955-70af-446d-ab49-fdb1bdc107a4" released by "delete_volume" :: held 1.701s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Created reservations ['eaeede12-b558-48d7-b682-2ab072058b2a', '4aefe719-b5b3-4992-96ce-4fc930e7c3e1', '928ba438-3041-4a13-b94c-ea3a44ec863b', '606ad9b6-1c7b-4d14-b2a9-692a34435773'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:02 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:02 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:02 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.838s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:02 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Deleted volume successfully. Jul 03 17:37:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f1ec04ab-111d-4d73-bcbb-eb9d83ed2ccd tempest-VolumesCloneTest-33612493 None] Lock "cinder-86055016-6018-408b-8ee5-2ef13bc6d542-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Flow 'volume_create_manager' (3bf0c825-d2f3-4d13-bc19-4245083efe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f961c2-b056-4c9a-96dc-d0c20486714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f961c2-b056-4c9a-96dc-d0c20486714a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487166289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0e2964-2111-4731-8562-8625f739da24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460cabe53af94e4b8063498f546d4c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:04Z,use_quota=True,user_id='a31fa6c4eac74c999758bde8d5d6678e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2680c9b2-dbc7-49ba-a8c6-76035806262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2680c9b2-dbc7-49ba-a8c6-76035806262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b7d10-8069-4ed7-aedb-57b84967589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:03 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b7d10-8069-4ed7-aedb-57b84967589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0e2964-2111-4731-8562-8625f739da24', 'volume_name': 'volume-cc0e2964-2111-4731-8562-8625f739da24', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07607962-2407-46db-977e-29bd8c2d5e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07607962-2407-46db-977e-29bd8c2d5e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13eefd39-b68c-4c4e-bdd8-ea2480829e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:03 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Volume cc0e2964-2111-4731-8562-8625f739da24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0e2964-2111-4731-8562-8625f739da24', 'volume_size': 1} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487166289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0e2964-2111-4731-8562-8625f739da24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460cabe53af94e4b8063498f546d4c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:04Z,use_quota=True,user_id='a31fa6c4eac74c999758bde8d5d6678e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Creating volume cc0e2964-2111-4731-8562-8625f739da24 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:03 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.242s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Deleted volume successfully. Jul 03 17:37:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a4c03749-bd38-4a5e-a7ed-87880cc356f6 tempest-ProjectReaderTests-233390883 None] Lock "cinder-26bc0955-70af-446d-ab49-fdb1bdc107a4-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:03 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 1073741824 Jul 03 17:37:03 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:04 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 1073741824" returned: 0 in 1.109s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:04 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 Jul 03 17:37:04 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:05 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13eefd39-b68c-4c4e-bdd8-ea2480829e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0e2964-2111-4731-8562-8625f739da24', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe9dbf4-bd5d-4916-bcdc-189398cdb822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Volume volume-cc0e2964-2111-4731-8562-8625f739da24 (cc0e2964-2111-4731-8562-8625f739da24): created successfully Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe9dbf4-bd5d-4916-bcdc-189398cdb822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Flow 'volume_create_manager' (3bf0c825-d2f3-4d13-bc19-4245083efe63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ee685b0b-61eb-4cc3-ac9d-cc7d354c556a tempest-ProjectReaderTests-233390883 None] Created volume successfully. Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Flow 'volume_create_manager' (d0a9e188-8fc5-4a0d-b035-fef5e28ecb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e937a6d9-253c-4680-b005-8212d85e1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e937a6d9-253c-4680-b005-8212d85e1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1603168474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c922702b-8935-44bc-9dfa-d029bd74305d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75e97cdcb644c5783254c59797235e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:06Z,use_quota=True,user_id='16caf789e51348aea68a70974991506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d830faff-4c6e-4ea9-96c8-44997232f035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d830faff-4c6e-4ea9-96c8-44997232f035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04893c-4e60-4378-a41c-ba03a634db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04893c-4e60-4378-a41c-ba03a634db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c922702b-8935-44bc-9dfa-d029bd74305d', 'volume_name': 'volume-c922702b-8935-44bc-9dfa-d029bd74305d', 'volume_size': 2}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274bb4fe-0a52-455a-9ddd-698fb086310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274bb4fe-0a52-455a-9ddd-698fb086310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38864b0-3159-4629-af8e-f80792c6c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:06 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Volume c922702b-8935-44bc-9dfa-d029bd74305d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c922702b-8935-44bc-9dfa-d029bd74305d', 'volume_size': 2} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1603168474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c922702b-8935-44bc-9dfa-d029bd74305d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75e97cdcb644c5783254c59797235e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:06Z,use_quota=True,user_id='16caf789e51348aea68a70974991506a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Creating volume c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:06 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d 2147483648 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:06 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d 2147483648 Jul 03 17:37:06 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Acquiring lock "cinder-cc0e2964-2111-4731-8562-8625f739da24-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Lock "cinder-cc0e2964-2111-4731-8562-8625f739da24-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Acquiring lock "cinder-quobyte-cc0e2964-2111-4731-8562-8625f739da24" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Lock "cinder-quobyte-cc0e2964-2111-4731-8562-8625f739da24" acquired by "delete_volume" :: waited 0.042s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:07 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a328f6-c511-41d1-88fb-d858a444bbe6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:07 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 Jul 03 17:37:07 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:07 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d 2147483648" returned: 0 in 1.524s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:08 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d Jul 03 17:37:08 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:08 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24" returned: 0 in 1.217s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:08 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24 Jul 03 17:37:08 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:09 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d" returned: 0 in 1.197s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] <== create_volume: return (2785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.787s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38864b0-3159-4629-af8e-f80792c6c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c922702b-8935-44bc-9dfa-d029bd74305d', 'volume_size': 2}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58498f05-f5b4-41ed-8f36-ab513024a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Volume volume-c922702b-8935-44bc-9dfa-d029bd74305d (c922702b-8935-44bc-9dfa-d029bd74305d): created successfully Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58498f05-f5b4-41ed-8f36-ab513024a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Flow 'volume_create_manager' (d0a9e188-8fc5-4a0d-b035-fef5e28ecb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0e4a6c1a-745b-4da3-b97f-76cb8fab9d6d tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Created volume successfully. Jul 03 17:37:09 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-cc0e2964-2111-4731-8562-8625f739da24" returned: 0 in 1.170s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Lock "cinder-quobyte-cc0e2964-2111-4731-8562-8625f739da24" released by "delete_volume" :: held 2.488s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Created reservations ['52d26430-0979-445d-996c-4aba9b24bde4', '942eea11-3ebe-467e-98fd-d1ab8739e5c0', '846b02d2-a497-45ab-8fad-420f79646a86', '4d4c4e73-5dd3-470a-9414-2105fcb7c1fa'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Creating offline snapshot 7a647603-7892-42d0-8807-5664b11f3b80 of volume c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88bc03-b082-4ee7-bb2d-e1bd842b41a0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:09 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:09 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:09 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d Jul 03 17:37:09 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:11 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.187s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:11 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Deleted volume successfully. Jul 03 17:37:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4911a54c-6280-4409-b613-fe98d8dcfad4 tempest-ProjectReaderTests-233390883 None] Lock "cinder-cc0e2964-2111-4731-8562-8625f739da24-delete_volume" released by "delete_volume" :: held 4.198s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:11 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d" returned: 0 in 1.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 2G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:11 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 2G Jul 03 17:37:11 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:12 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 2G" returned: 0 in 1.327s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c922702b-8935-44bc-9dfa-d029bd74305d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:12 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c922702b-8935-44bc-9dfa-d029bd74305d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 Jul 03 17:37:12 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:13 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c922702b-8935-44bc-9dfa-d029bd74305d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80" returned: 0 in 0.960s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:13 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 is being set with open permissions: ugo+rw Jul 03 17:37:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:13 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 Jul 03 17:37:13 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:14 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80" returned: 0 in 1.043s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:15 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info Jul 03 17:37:15 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:15 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info" returned: 0 in 0.767s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:15 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info is being set with open permissions: ugo+rw Jul 03 17:37:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:15 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info Jul 03 17:37:15 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:16 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.info" returned: 0 in 1.057s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.030s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4d1c0f2c-8622-4e44-8b58-74d15c002ff7 tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Create snapshot completed successfully Jul 03 17:37:16 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Flow 'volume_create_manager' (d3b412e4-5f6d-4e2c-84dd-b4b46e6a55f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6566b31e-fb3b-4292-bbb1-10ee2d40fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6566b31e-fb3b-4292-bbb1-10ee2d40fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1941432295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a5f0f-0128-4ad6-b09a-27837620a188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f42b30988446b2866b921a32c305b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:17Z,use_quota=True,user_id='00d59079681444b687180d384b5e7f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437ffc49-6156-474c-8c9d-0e416047cabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437ffc49-6156-474c-8c9d-0e416047cabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cd88a1-3076-472e-b73d-6b63844d3e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cd88a1-3076-472e-b73d-6b63844d3e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03a5f0f-0128-4ad6-b09a-27837620a188', 'volume_name': 'volume-f03a5f0f-0128-4ad6-b09a-27837620a188', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc91f2f-8aca-4540-af4d-1216731ca521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc91f2f-8aca-4540-af4d-1216731ca521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95666da3-783f-454e-ac15-0d8f563f185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:17 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Volume f03a5f0f-0128-4ad6-b09a-27837620a188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03a5f0f-0128-4ad6-b09a-27837620a188', 'volume_size': 1} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1941432295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a5f0f-0128-4ad6-b09a-27837620a188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f42b30988446b2866b921a32c305b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:17Z,use_quota=True,user_id='00d59079681444b687180d384b5e7f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Creating volume f03a5f0f-0128-4ad6-b09a-27837620a188 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:17 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:17 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 1073741824 Jul 03 17:37:17 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "cinder-7a647603-7892-42d0-8807-5664b11f3b80-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-7a647603-7892-42d0-8807-5664b11f3b80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "cinder-quobyte-c922702b-8935-44bc-9dfa-d029bd74305d" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-quobyte-c922702b-8935-44bc-9dfa-d029bd74305d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "cinder-quobyte-7a647603-7892-42d0-8807-5664b11f3b80" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-quobyte-7a647603-7892-42d0-8807-5664b11f3b80" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Deleting offline snapshot 7a647603-7892-42d0-8807-5664b11f3b80 of volume c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] snapshot_file for this snap is: volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cc3dd4-8631-4ec6-866f-79e2a189a5e4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:17 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 Jul 03 17:37:17 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:18 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 1073741824" returned: 0 in 1.164s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:18 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 Jul 03 17:37:18 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:18 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80" returned: 0 in 0.930s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c922702b-8935-44bc-9dfa-d029bd74305d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:37:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb395472-35c0-4249-9522-ac0514f3d6d5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:18 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d Jul 03 17:37:18 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:19 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188" returned: 0 in 0.931s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95666da3-783f-454e-ac15-0d8f563f185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03a5f0f-0128-4ad6-b09a-27837620a188', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6521ae69-419b-4fe2-a912-69982d70d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:19 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Volume volume-f03a5f0f-0128-4ad6-b09a-27837620a188 (f03a5f0f-0128-4ad6-b09a-27837620a188): created successfully Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6521ae69-419b-4fe2-a912-69982d70d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Flow 'volume_create_manager' (d3b412e4-5f6d-4e2c-84dd-b4b46e6a55f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:19 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1e0fb4e3-6d72-4538-8a4c-db47cca10dbb tempest-VolumesTransfersTest-774433657 None] Created volume successfully. Jul 03 17:37:19 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d" returned: 0 in 0.924s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:19 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 Jul 03 17:37:19 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:20 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:20 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80 Jul 03 17:37:20 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5a25146a-c991-442c-9655-6c92e9b41142 tempest-VolumesTransfersTest-1002292113 None] Transfer volume completed successfully. Jul 03 17:37:20 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d.7a647603-7892-42d0-8807-5664b11f3b80" returned: 0 in 0.641s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-quobyte-7a647603-7892-42d0-8807-5664b11f3b80" released by "_delete_snapshot" :: held 3.396s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-quobyte-c922702b-8935-44bc-9dfa-d029bd74305d" released by "delete_snapshot" :: held 3.427s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Created reservations ['c68c0dfd-2c62-4a7c-961e-38c0fff70eb2', '8938148f-6bad-4e14-adc8-0512ed4e9aeb', 'e2544a74-06aa-4a9f-9673-cbae820101dc', 'f7cabd2f-3df3-417b-8895-6462fdc413d7'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:21 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Delete snapshot completed successfully. Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c81e5688-88f0-4d1c-a8d1-5069233911de tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-7a647603-7892-42d0-8807-5664b11f3b80-delete_snapshot" released by "delete_snapshot" :: held 3.562s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Acquiring lock "cinder-f03a5f0f-0128-4ad6-b09a-27837620a188-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-f03a5f0f-0128-4ad6-b09a-27837620a188-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Acquiring lock "cinder-quobyte-f03a5f0f-0128-4ad6-b09a-27837620a188" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-quobyte-f03a5f0f-0128-4ad6-b09a-27837620a188" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a228e46-6721-4ba1-a76a-0449333e6d15]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:21 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 Jul 03 17:37:21 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "cinder-c922702b-8935-44bc-9dfa-d029bd74305d-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-c922702b-8935-44bc-9dfa-d029bd74305d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "cinder-quobyte-c922702b-8935-44bc-9dfa-d029bd74305d" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-quobyte-c922702b-8935-44bc-9dfa-d029bd74305d" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35465aaa-10c5-4526-a2e2-1602af3c7c38]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:22 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d Jul 03 17:37:22 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:22 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188" returned: 0 in 0.793s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:22 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188 Jul 03 17:37:22 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:22 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d" returned: 0 in 0.790s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:22 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d Jul 03 17:37:22 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:23 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-f03a5f0f-0128-4ad6-b09a-27837620a188" returned: 0 in 0.714s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-quobyte-f03a5f0f-0128-4ad6-b09a-27837620a188" released by "delete_volume" :: held 1.551s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Created reservations ['8bf25f23-b184-49cc-b8f3-9da29041a690', '15fd4cfd-ddb1-483a-b42d-bde99cbc73ff', 'c72b3870-284e-443e-b323-9dd014e212a4', '2eea9285-3d4d-4877-923e-70a1c3411215'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:23 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:23 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:23 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c922702b-8935-44bc-9dfa-d029bd74305d" returned: 0 in 0.704s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-quobyte-c922702b-8935-44bc-9dfa-d029bd74305d" released by "delete_volume" :: held 1.560s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Created reservations ['d844abef-b4e4-4e50-8d2a-01675408260f', '084b89d5-7c5f-4d09-81cf-d8997b3aeaaa', '35262288-9e2b-433c-810a-8090113eb502', '63259ba8-bc6e-4672-8fb6-c4ebc70b088f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:23 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:23 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:24 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.695s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Deleted volume successfully. Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-14d26ed2-8bb4-42cb-9e93-148591d60913 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-f03a5f0f-0128-4ad6-b09a-27837620a188-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Flow 'volume_create_manager' (3cd38640-f354-462c-ab28-e5ae0b82ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5f6374-3edf-42cc-ae4e-5a5cf255a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5f6374-3edf-42cc-ae4e-5a5cf255a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1645223102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1256abda-08bb-44b5-b430-8bb3ad851f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f42b30988446b2866b921a32c305b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:24Z,use_quota=True,user_id='00d59079681444b687180d384b5e7f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ac2793-aba5-443e-9a6d-6c3f100d6d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ac2793-aba5-443e-9a6d-6c3f100d6d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480d05a0-218b-4114-8f53-5f40bf16fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480d05a0-218b-4114-8f53-5f40bf16fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1256abda-08bb-44b5-b430-8bb3ad851f26', 'volume_name': 'volume-1256abda-08bb-44b5-b430-8bb3ad851f26', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b523a138-e9ed-4656-b024-7e4fbe7fca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b523a138-e9ed-4656-b024-7e4fbe7fca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:24 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c77ede7-834a-4b13-94d5-f8612f043366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Volume 1256abda-08bb-44b5-b430-8bb3ad851f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1256abda-08bb-44b5-b430-8bb3ad851f26', 'volume_size': 1} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1645223102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1256abda-08bb-44b5-b430-8bb3ad851f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f42b30988446b2866b921a32c305b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:24Z,use_quota=True,user_id='00d59079681444b687180d384b5e7f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Creating volume 1256abda-08bb-44b5-b430-8bb3ad851f26 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:24 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.908s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Deleted volume successfully. Jul 03 17:37:24 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 1073741824 Jul 03 17:37:24 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a6ee4c71-7ba1-43e9-b590-c50d801d1c3e tempest-VolumesSnapshotNegativeTestJSON-897336651 None] Lock "cinder-c922702b-8935-44bc-9dfa-d029bd74305d-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:25 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 1073741824" returned: 0 in 0.906s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:25 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 Jul 03 17:37:25 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:26 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26" returned: 0 in 0.671s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c77ede7-834a-4b13-94d5-f8612f043366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1256abda-08bb-44b5-b430-8bb3ad851f26', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6354e533-551f-4339-a43c-c7da09ec5408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Volume volume-1256abda-08bb-44b5-b430-8bb3ad851f26 (1256abda-08bb-44b5-b430-8bb3ad851f26): created successfully Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6354e533-551f-4339-a43c-c7da09ec5408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Flow 'volume_create_manager' (3cd38640-f354-462c-ab28-e5ae0b82ffca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:26 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-555db532-e8a3-49e0-961c-1bc5d79f9993 tempest-VolumesTransfersTest-774433657 None] Created volume successfully. Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Acquiring lock "cinder-1256abda-08bb-44b5-b430-8bb3ad851f26-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-1256abda-08bb-44b5-b430-8bb3ad851f26-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Acquiring lock "cinder-quobyte-1256abda-08bb-44b5-b430-8bb3ad851f26" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-quobyte-1256abda-08bb-44b5-b430-8bb3ad851f26" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5145cf8c-2956-4e0c-94b7-4506a662d3e5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:27 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 Jul 03 17:37:27 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:27 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26" returned: 0 in 0.806s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:27 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26 Jul 03 17:37:27 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:28 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1256abda-08bb-44b5-b430-8bb3ad851f26" returned: 0 in 0.624s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-quobyte-1256abda-08bb-44b5-b430-8bb3ad851f26" released by "delete_volume" :: held 1.478s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Created reservations ['88c49c6a-6fa2-4def-a1fc-0f983ddad065', 'a3457384-1b09-4757-ac82-fcfe435b3c6d', '221d19c6-6c2c-4698-8fa7-82122453db10', 'e992548b-534a-43b1-83b4-70a9d26c1c65'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:28 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:28 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:29 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.641s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:29 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Deleted volume successfully. Jul 03 17:37:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-781c0e22-63fc-44d3-bb18-309cc95450a3 tempest-VolumesTransfersTest-1475226433 None] Lock "cinder-1256abda-08bb-44b5-b430-8bb3ad851f26-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:38 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=85,cinder:SELECT=62,cinder:DELETE=8,cinder:INSERT=18 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:37:38 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Flow 'volume_create_manager' (7bf36ffa-d74c-4ae1-8271-9ffb665c5272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc9ba0b-9e47-4a84-9ada-1f3f081626f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc9ba0b-9e47-4a84-9ada-1f3f081626f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-232842696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b897053-5514-4a85-8eb9-e17f27d34991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21db765ddfe04dc2bb1aaf94aca67eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:39Z,use_quota=True,user_id='21962165e30d4ac79470e1b9fa2fe1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c3ace2-3c49-4010-a8db-b22277f74880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c3ace2-3c49-4010-a8db-b22277f74880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eb0c01-bcca-4fdb-a28d-5ad86f013a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eb0c01-bcca-4fdb-a28d-5ad86f013a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b897053-5514-4a85-8eb9-e17f27d34991', 'volume_name': 'volume-8b897053-5514-4a85-8eb9-e17f27d34991', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a020ac57-179d-432c-a7de-10ee7c5fc81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a020ac57-179d-432c-a7de-10ee7c5fc81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03e04e6-b3fe-4b48-a02f-a20f57f9de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:39 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Volume 8b897053-5514-4a85-8eb9-e17f27d34991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b897053-5514-4a85-8eb9-e17f27d34991', 'volume_size': 1} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-232842696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b897053-5514-4a85-8eb9-e17f27d34991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21db765ddfe04dc2bb1aaf94aca67eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:39Z,use_quota=True,user_id='21962165e30d4ac79470e1b9fa2fe1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Creating volume 8b897053-5514-4a85-8eb9-e17f27d34991 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:39 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:39 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 1073741824 Jul 03 17:37:39 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:39 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 1073741824" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:40 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 Jul 03 17:37:40 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:40 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991" returned: 0 in 0.779s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03e04e6-b3fe-4b48-a02f-a20f57f9de4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b897053-5514-4a85-8eb9-e17f27d34991', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f18675-c4ba-4ffe-8864-302a55ab6dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Volume volume-8b897053-5514-4a85-8eb9-e17f27d34991 (8b897053-5514-4a85-8eb9-e17f27d34991): created successfully Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f18675-c4ba-4ffe-8864-302a55ab6dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Flow 'volume_create_manager' (7bf36ffa-d74c-4ae1-8271-9ffb665c5272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5665f7bc-366d-43ef-85ea-74ceea6c9f7c tempest-VolumesTransfersV357Test-1313653490 None] Created volume successfully. Jul 03 17:37:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-352d02f0-0f61-4627-a7c4-285df7de341a tempest-VolumesTransfersV357Test-611463994 None] Transfer volume completed successfully. Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddcd5c8-c388-4928-b722-7927aa4af0f2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:42 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 Jul 03 17:37:42 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Acquiring lock "cinder-8b897053-5514-4a85-8eb9-e17f27d34991-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-8b897053-5514-4a85-8eb9-e17f27d34991-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Acquiring lock "cinder-quobyte-8b897053-5514-4a85-8eb9-e17f27d34991" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-quobyte-8b897053-5514-4a85-8eb9-e17f27d34991" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e7b6e-6cf1-4c8f-8893-cc1b9206ab67]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:43 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 Jul 03 17:37:43 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:43 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75" returned: 0 in 0.955s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-8b7ed684-b9fd-4858-9155-871418868f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71c65b1c-a672-46e5-901e-ab500050b5cd', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:37:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-80e501bd-1ba2-4e05-8cd6-7edcf5f12028 req-c501094a-e0d0-4722-b199-d588ca7aff00 tempest-TestInstancesWithCinderVolumes-1725704358 None] attachment_update completed successfully. Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:43 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991" returned: 0 in 0.876s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:43 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:43 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:43 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991 Jul 03 17:37:43 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:44 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.753s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:37:44 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b897053-5514-4a85-8eb9-e17f27d34991" returned: 0 in 0.808s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-quobyte-8b897053-5514-4a85-8eb9-e17f27d34991" released by "delete_volume" :: held 1.743s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Created reservations ['d407033f-7c94-44a1-b74a-7032d8974075', 'e583edb7-12f0-45cc-8303-8b8403681876', 'ad90f32c-8417-4ade-98a0-86cc091d8399', '7604578f-96f9-451f-a59e-4340132472af'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:44 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:44 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:45 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Deleted volume successfully. Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42374945-6746-461e-b3f6-a23d17abcfdf tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-8b897053-5514-4a85-8eb9-e17f27d34991-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Flow 'volume_create_manager' (b001e655-f6b2-49cd-8053-154ebb599ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af5f851-8c20-4406-a56c-65ea919e1994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af5f851-8c20-4406-a56c-65ea919e1994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1187900661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d89106-a49c-459e-a33f-7e24b8892561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21db765ddfe04dc2bb1aaf94aca67eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:46Z,use_quota=True,user_id='21962165e30d4ac79470e1b9fa2fe1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7ed8d4-72a9-44b4-b299-84977d4d0809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7ed8d4-72a9-44b4-b299-84977d4d0809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de19a55-3ef4-4622-932e-7f508bbc9248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de19a55-3ef4-4622-932e-7f508bbc9248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d89106-a49c-459e-a33f-7e24b8892561', 'volume_name': 'volume-a5d89106-a49c-459e-a33f-7e24b8892561', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f9a13e-c69b-45f7-8af9-43545d9c43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f9a13e-c69b-45f7-8af9-43545d9c43e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aa093b-2eda-4953-9648-8cd19bf1d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:45 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Volume a5d89106-a49c-459e-a33f-7e24b8892561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d89106-a49c-459e-a33f-7e24b8892561', 'volume_size': 1} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1187900661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d89106-a49c-459e-a33f-7e24b8892561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21db765ddfe04dc2bb1aaf94aca67eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:46Z,use_quota=True,user_id='21962165e30d4ac79470e1b9fa2fe1af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Creating volume a5d89106-a49c-459e-a33f-7e24b8892561 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:45 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:45 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 1073741824 Jul 03 17:37:45 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:46 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 1073741824" returned: 0 in 0.868s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:46 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 Jul 03 17:37:46 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:47 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561" returned: 0 in 0.740s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aa093b-2eda-4953-9648-8cd19bf1d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d89106-a49c-459e-a33f-7e24b8892561', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddafd8c4-ed00-4522-847b-5365e92c3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:47 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Volume volume-a5d89106-a49c-459e-a33f-7e24b8892561 (a5d89106-a49c-459e-a33f-7e24b8892561): created successfully Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddafd8c4-ed00-4522-847b-5365e92c3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Flow 'volume_create_manager' (b001e655-f6b2-49cd-8053-154ebb599ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3793cbf8-36e7-4a7a-9ca7-3c8e1706148e tempest-VolumesTransfersV357Test-1313653490 None] Created volume successfully. Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Flow 'volume_create_manager' (2733aab8-8612-4a97-8067-497004ebe783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c3d3f-dd0e-40b6-b783-bef0b6101e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c3d3f-dd0e-40b6-b783-bef0b6101e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-780791156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dd7c9b-deae-44d2-8de3-5d9d7abec801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5296569f1b3c4e42b25531053e807016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:48Z,use_quota=True,user_id='27b6d1bb995b4c94ad8b2dc8cc725ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb781f08-f399-4cbf-a418-30a6008fb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb781f08-f399-4cbf-a418-30a6008fb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60417d92-10f3-4fa3-a5fb-6f63a0cc7593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60417d92-10f3-4fa3-a5fb-6f63a0cc7593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94dd7c9b-deae-44d2-8de3-5d9d7abec801', 'volume_name': 'volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686c46d0-b7e7-4922-800b-53ca29f01b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686c46d0-b7e7-4922-800b-53ca29f01b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65384bb0-f982-47be-a1c5-52f444623cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Volume 94dd7c9b-deae-44d2-8de3-5d9d7abec801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801', 'volume_size': 1} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-780791156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dd7c9b-deae-44d2-8de3-5d9d7abec801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5296569f1b3c4e42b25531053e807016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:48Z,use_quota=True,user_id='27b6d1bb995b4c94ad8b2dc8cc725ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Creating volume 94dd7c9b-deae-44d2-8de3-5d9d7abec801 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:48 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Acquiring lock "cinder-a5d89106-a49c-459e-a33f-7e24b8892561-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-a5d89106-a49c-459e-a33f-7e24b8892561-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:48 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 1073741824 Jul 03 17:37:48 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Acquiring lock "cinder-quobyte-a5d89106-a49c-459e-a33f-7e24b8892561" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-quobyte-a5d89106-a49c-459e-a33f-7e24b8892561" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d9f31-548b-41c9-ae68-edbe92c843c5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:48 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 Jul 03 17:37:48 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Flow 'volume_create_manager' (d0a12fcb-8108-4d2a-9d98-083ab5d279ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df098c7c-bb5c-469a-8e3c-2f9426351803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df098c7c-bb5c-469a-8e3c-2f9426351803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-623898246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795e4d30-1f8f-4d7c-a4ce-12c6af5932b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5296569f1b3c4e42b25531053e807016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:49Z,use_quota=True,user_id='27b6d1bb995b4c94ad8b2dc8cc725ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14454305-2e7c-46a9-bbf2-a5d2be249187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14454305-2e7c-46a9-bbf2-a5d2be249187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac1b339-8fce-45a3-b2bf-83fe6b15b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac1b339-8fce-45a3-b2bf-83fe6b15b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795e4d30-1f8f-4d7c-a4ce-12c6af5932b8', 'volume_name': 'volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc548c5a-5fca-42fd-a070-90adc4e9d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc548c5a-5fca-42fd-a070-90adc4e9d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f460732-9f33-4598-82ab-b8979c9b7c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Volume 795e4d30-1f8f-4d7c-a4ce-12c6af5932b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8', 'volume_size': 1} Jul 03 17:37:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:49 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 1073741824" returned: 0 in 1.111s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:49 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 Jul 03 17:37:49 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:49 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561" returned: 0 in 0.998s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:49 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561 Jul 03 17:37:49 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:50 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801" returned: 0 in 0.715s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.220s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-623898246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795e4d30-1f8f-4d7c-a4ce-12c6af5932b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5296569f1b3c4e42b25531053e807016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:49Z,use_quota=True,user_id='27b6d1bb995b4c94ad8b2dc8cc725ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Creating volume 795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:50 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:50 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a5d89106-a49c-459e-a33f-7e24b8892561" returned: 0 in 0.718s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:50 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 1073741824 Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65384bb0-f982-47be-a1c5-52f444623cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:50 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698d1ece-d9fb-4ffd-9807-7a7a0a49db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-quobyte-a5d89106-a49c-459e-a33f-7e24b8892561" released by "delete_volume" :: held 1.803s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:50 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Volume volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 (94dd7c9b-deae-44d2-8de3-5d9d7abec801): created successfully Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698d1ece-d9fb-4ffd-9807-7a7a0a49db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Flow 'volume_create_manager' (2733aab8-8612-4a97-8067-497004ebe783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ed5e4081-2325-4dc3-8be5-c79607fbc20c tempest-TestServerVolumeAttachmentScenario-888534397 None] Created volume successfully. Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Created reservations ['5951c341-41f2-477e-9187-bf18f006689c', 'da5c047d-846b-4f1e-b73e-0974aa69e9b1', '501758c2-1bfa-4e02-9dee-62ff57cbe3b9', '197efff3-edf6-4fda-9f55-3476adf98a54'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:50 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:37:50 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:51 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 1073741824" returned: 0 in 1.004s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:51 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.772s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:37:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Deleted volume successfully. Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3edab8e7-09c2-4bc7-8ea9-931d230548b4 tempest-VolumesTransfersV357Test-285610288 None] Lock "cinder-a5d89106-a49c-459e-a33f-7e24b8892561-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:51 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 Jul 03 17:37:51 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:51 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" returned: 0 in 0.767s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f460732-9f33-4598-82ab-b8979c9b7c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb937089-57bc-40ed-a9e2-3a9b47cff802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:51 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Volume volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 (795e4d30-1f8f-4d7c-a4ce-12c6af5932b8): created successfully Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb937089-57bc-40ed-a9e2-3a9b47cff802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Flow 'volume_create_manager' (d0a12fcb-8108-4d2a-9d98-083ab5d279ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:51 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=110,cinder:SELECT=77,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:37:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-41c748c2-94f9-4bd5-9768-edfdb633cb76 tempest-TestServerVolumeAttachmentScenario-888534397 None] Created volume successfully. Jul 03 17:37:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6bac23-1091-4328-9aa6-d4f231b870ac]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:37:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:52 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 Jul 03 17:37:52 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:53 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514" returned: 0 in 0.874s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-954ea081-bf67-40cf-95cb-d6ab081ab514', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cc7104c-2fe7-4527-bf30-40cbdcbc38f6', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:37:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-d540b8ea-3be2-40f1-8200-a519d466b23f req-675c776b-703f-46b4-be20-3629e6cb747e tempest-TestInstancesWithCinderVolumes-1725704358 None] attachment_update completed successfully. Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (d0a5c7a8-52ce-482c-a952-15d48b96d444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fe37de-24b8-495b-ab46-e74dedb70f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fe37de-24b8-495b-ab46-e74dedb70f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-864108196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdf26f9-4ace-4316-aca7-96f798be1cd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:56Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9428d09-69b2-40b5-b80c-47d9f92e803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9428d09-69b2-40b5-b80c-47d9f92e803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e2b8e1-34f9-4858-bf82-a2ee6049fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e2b8e1-34f9-4858-bf82-a2ee6049fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdf26f9-4ace-4316-aca7-96f798be1cd4', 'volume_name': 'volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f649dd49-bae0-436a-91f0-72c753d9452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f649dd49-bae0-436a-91f0-72c753d9452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d147b3-8576-471b-bd11-155e131962c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:56 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Volume ffdf26f9-4ace-4316-aca7-96f798be1cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4', 'volume_size': 1} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-864108196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdf26f9-4ace-4316-aca7-96f798be1cd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:56Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Creating volume ffdf26f9-4ace-4316-aca7-96f798be1cd4 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:56 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:56 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 1073741824 Jul 03 17:37:56 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:57 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 1073741824" returned: 0 in 0.883s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:57 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 Jul 03 17:37:57 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:37:58 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d147b3-8576-471b-bd11-155e131962c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08d218b-18c5-43e2-8c26-d39e930c1649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:58 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Volume volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 (ffdf26f9-4ace-4316-aca7-96f798be1cd4): created successfully Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08d218b-18c5-43e2-8c26-d39e930c1649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (d0a5c7a8-52ce-482c-a952-15d48b96d444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-92dc9d29-eb39-4967-91a5-32425bbf35cf tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (a71ccf11-64b5-4aef-9c04-c0d2e991b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18878e9a-369a-4294-80d0-ce5e05d5cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18878e9a-369a-4294-80d0-ce5e05d5cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-566588727',display_name='tempest-VolumesGetTest-Volume-1328415483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:59Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3ade14-b3d0-4439-b3ad-bdbb060d4a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3ade14-b3d0-4439-b3ad-bdbb060d4a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9896f-3085-4989-a7b8-48ae5d0a2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9896f-3085-4989-a7b8-48ae5d0a2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa', 'volume_name': 'volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706b5c22-c3b0-41dc-8afe-17cdfc94855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706b5c22-c3b0-41dc-8afe-17cdfc94855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e167e01-7ba1-4bcb-8268-1c38acd6c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:37:59 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Volume b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa', 'volume_size': 1} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:37:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-566588727',display_name='tempest-VolumesGetTest-Volume-1328415483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:37:59Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Creating volume b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:37:59 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:37:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:37:59 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa 1073741824 Jul 03 17:37:59 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:00 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa 1073741824" returned: 0 in 0.899s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:00 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa Jul 03 17:38:00 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:01 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa" returned: 0 in 0.636s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e167e01-7ba1-4bcb-8268-1c38acd6c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afdfbe5-77b5-4d92-9f5a-b5476f975730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:01 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Volume volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa (b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa): created successfully Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afdfbe5-77b5-4d92-9f5a-b5476f975730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (a71ccf11-64b5-4aef-9c04-c0d2e991b36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-337eead8-7892-43bb-b62c-95990c8139a1 tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Lock "cinder-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac34ec1-f3de-47e1-bcbf-02f90e901e11]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:01 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa Jul 03 17:38:01 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:02 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa" returned: 0 in 0.747s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:02 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa Jul 03 17:38:02 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:02 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-f9ee7ed2-4a43-4ae6-b000-f20ccb365030 req-0215799f-33da-4942-af2a-a665d89fcac0 tempest-TestInstancesWithCinderVolumes-1725704358 None] Terminate volume connection completed successfully. Jul 03 17:38:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-f9ee7ed2-4a43-4ae6-b000-f20ccb365030 req-0215799f-33da-4942-af2a-a665d89fcac0 tempest-TestInstancesWithCinderVolumes-1725704358 None] Deleting attachment 71c65b1c-a672-46e5-901e-ab500050b5cd. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:38:03 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa" returned: 0 in 0.651s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa" released by "delete_volume" :: held 1.443s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Created reservations ['84fad7a4-b00a-49a0-a74d-b8bca602a703', '589e4b20-394a-4995-9fdb-577aa78ac987', 'd2505727-3c91-4fa2-8b3c-134c7bac9e55', '356afaa3-1daf-4e18-8c84-a7daca4fefad'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:03 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:03 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:03 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-16b73d3c-fddf-4fe8-bf6f-e35540955e48 tempest-VolumesGetTest-1260374467 None] Lock "cinder-b4f2e87b-9c8d-4fa9-bfba-5f33cec100fa-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-ffdf26f9-4ace-4316-aca7-96f798be1cd4-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Lock "cinder-ffdf26f9-4ace-4316-aca7-96f798be1cd4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-ffdf26f9-4ace-4316-aca7-96f798be1cd4" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-ffdf26f9-4ace-4316-aca7-96f798be1cd4" acquired by "delete_volume" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45261c1-3590-402c-9cac-1ecd1c80b734]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:04 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 Jul 03 17:38:04 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:04 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4" returned: 0 in 0.871s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:04 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4 Jul 03 17:38:04 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "cinder-8b7ed684-b9fd-4858-9155-871418868f75-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-8b7ed684-b9fd-4858-9155-871418868f75-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "cinder-quobyte-8b7ed684-b9fd-4858-9155-871418868f75" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-quobyte-8b7ed684-b9fd-4858-9155-871418868f75" acquired by "delete_volume" :: waited 0.037s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2009529-81a9-43dd-a94a-48c3bd0bbd72]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:05 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 Jul 03 17:38:05 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:05 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ffdf26f9-4ace-4316-aca7-96f798be1cd4" returned: 0 in 1.103s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-ffdf26f9-4ace-4316-aca7-96f798be1cd4" released by "delete_volume" :: held 2.028s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Created reservations ['12b9d79b-4a4d-4341-926b-b34dacbd93b8', '72a99309-20c2-44cc-9b25-7e0f201ffc81', '4f69db53-8ffc-4c1d-88a8-cc4734ea4c16', 'e86c5b48-1e4b-4082-ad6f-bb05c8623628'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:06 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:06 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:06 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75" returned: 0 in 1.548s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:06 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75 Jul 03 17:38:06 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (88e00828-e7fe-42db-ac0e-3e5f72382f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be6cd9b-04dc-483f-bdd2-f964005b54b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be6cd9b-04dc-483f-bdd2-f964005b54b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1856263979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a06ceee-87a6-48ce-b0f9-99d36619331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:07Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d854da9f-1235-4c8b-b133-8c6c7951bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d854da9f-1235-4c8b-b133-8c6c7951bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038037f2-e9ed-4a55-bea6-a3112a0d67a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038037f2-e9ed-4a55-bea6-a3112a0d67a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a06ceee-87a6-48ce-b0f9-99d36619331b', 'volume_name': 'volume-4a06ceee-87a6-48ce-b0f9-99d36619331b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc4f463-49fb-43ef-a4e4-a15804c6670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc4f463-49fb-43ef-a4e4-a15804c6670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a57aa7-0092-4c2e-95ee-017cf69e988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Volume 4a06ceee-87a6-48ce-b0f9-99d36619331b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a06ceee-87a6-48ce-b0f9-99d36619331b', 'volume_size': 1} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1856263979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a06ceee-87a6-48ce-b0f9-99d36619331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:07Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Creating volume 4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:38:07 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:07 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b 1073741824 Jul 03 17:38:07 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:07 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.251s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ae5abb5b-823a-4f6a-8ea9-fd22735508a1 tempest-VolumesGetTest-1260374467 None] Lock "cinder-ffdf26f9-4ace-4316-aca7-96f798be1cd4-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:07 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8b7ed684-b9fd-4858-9155-871418868f75" returned: 0 in 1.062s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-quobyte-8b7ed684-b9fd-4858-9155-871418868f75" released by "delete_volume" :: held 2.697s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:07 devstack cinder-volume[86621]: WARNING cinder.quota [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1501167471-672829554 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1501167471-672829554, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:38:07 devstack cinder-volume[86621]: WARNING cinder.quota [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1501167471-672829554 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1501167471-672829554, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:38:07 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Created reservations ['e703a977-ee87-44f3-9c31-0cb941502dcd', '763a7f07-fe3a-4367-a200-545721a9797d', '4903b61c-64f7-47fb-95a7-07796f584cf7', '2d5dd5ea-4021-48ad-8440-4243f4010f7a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:08 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:08 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:08 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b 1073741824" returned: 0 in 1.480s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:08 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:08 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Deleted volume successfully. Jul 03 17:38:08 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:08 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0d9a42e-f5a7-40e9-8a44-4ea3a23c0a78 tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-8b7ed684-b9fd-4858-9155-871418868f75-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:09 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 0.923s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a57aa7-0092-4c2e-95ee-017cf69e988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a06ceee-87a6-48ce-b0f9-99d36619331b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efea7a3f-c758-4614-8980-5e6715e0b5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Volume volume-4a06ceee-87a6-48ce-b0f9-99d36619331b (4a06ceee-87a6-48ce-b0f9-99d36619331b): created successfully Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efea7a3f-c758-4614-8980-5e6715e0b5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (88e00828-e7fe-42db-ac0e-3e5f72382f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6b4b174e-67eb-4d2d-b4c3-377a8f5f085b tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (e9d42755-0850-4052-bb00-5c2def43ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16dacc7e-74bb-493a-a5b3-02ff180c1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16dacc7e-74bb-493a-a5b3-02ff180c1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-317863929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b9ed07-0b8c-4453-9ed0-0bf13d7379fa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4a06ceee-87a6-48ce-b0f9-99d36619331b,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:11Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723b53b8-9d55-46f2-b8bc-d1366d543461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723b53b8-9d55-46f2-b8bc-d1366d543461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5ca263-f2b0-43cc-9cc6-9143896fc889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5ca263-f2b0-43cc-9cc6-9143896fc889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '24b9ed07-0b8c-4453-9ed0-0bf13d7379fa', 'volume_name': 'volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa', 'volume_size': 1, 'source_volid': '4a06ceee-87a6-48ce-b0f9-99d36619331b', 'source_volstatus': 'available'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b674da-c8aa-44b2-9087-e7ea97bc4194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b674da-c8aa-44b2-9087-e7ea97bc4194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44bb572-ba04-4b6e-ae95-ed56661d8142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Volume 24b9ed07-0b8c-4453-9ed0-0bf13d7379fa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa', 'volume_size': 1, 'source_volid': '4a06ceee-87a6-48ce-b0f9-99d36619331b', 'source_volstatus': 'available'} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:10 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Cloning volume 4a06ceee-87a6-48ce-b0f9-99d36619331b to volume 24b9ed07-0b8c-4453-9ed0-0bf13d7379fa Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Creating offline snapshot 8310165a-cce1-4044-a733-cf93d268a54b of volume 4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca476596-b09d-4c07-a827-f6b4996836a6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:10 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:10 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-a470a709-bef8-4a56-9722-c80dc4895054 req-98009aeb-809e-4e0c-9517-333053162130 tempest-TestInstancesWithCinderVolumes-1725704358 None] Terminate volume connection completed successfully. Jul 03 17:38:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-a470a709-bef8-4a56-9722-c80dc4895054 req-98009aeb-809e-4e0c-9517-333053162130 tempest-TestInstancesWithCinderVolumes-1725704358 None] Deleting attachment 8cc7104c-2fe7-4527-bf30-40cbdcbc38f6. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:38:11 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 0.824s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:11 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b 1G Jul 03 17:38:11 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:12 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b 1G" returned: 0 in 0.809s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a06ceee-87a6-48ce-b0f9-99d36619331b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:12 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a06ceee-87a6-48ce-b0f9-99d36619331b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b Jul 03 17:38:12 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:13 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a06ceee-87a6-48ce-b0f9-99d36619331b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b" returned: 0 in 0.685s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:13 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b is being set with open permissions: ugo+rw Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "cinder-954ea081-bf67-40cf-95cb-d6ab081ab514-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:13 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b Jul 03 17:38:13 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-954ea081-bf67-40cf-95cb-d6ab081ab514-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "cinder-quobyte-954ea081-bf67-40cf-95cb-d6ab081ab514" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-quobyte-954ea081-bf67-40cf-95cb-d6ab081ab514" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[58226925-003c-46e9-9bf6-97ef5744cbe1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:13 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 Jul 03 17:38:13 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:13 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:14 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info Jul 03 17:38:14 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:14 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514" returned: 0 in 0.955s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:14 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514 Jul 03 17:38:14 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:14 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info" returned: 0 in 0.830s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:14 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info is being set with open permissions: ugo+rw Jul 03 17:38:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:14 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info Jul 03 17:38:14 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:15 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-954ea081-bf67-40cf-95cb-d6ab081ab514" returned: 0 in 1.132s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-quobyte-954ea081-bf67-40cf-95cb-d6ab081ab514" released by "delete_volume" :: held 2.137s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:15 devstack cinder-volume[86621]: WARNING cinder.quota [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185174929-2015299329 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185174929-2015299329, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:38:15 devstack cinder-volume[86621]: WARNING cinder.quota [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185174929-2015299329 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185174929-2015299329, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Created reservations ['ea007262-51a7-43a7-a1a5-e3d257724c36', '946090d5-c407-4ab4-822a-5ef7f0945674', '3a83f50c-a87e-4bae-979d-a0e6b181ac11', 'aac2d74b-58e2-468d-96d4-28d679f2cf75'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:15 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:15 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:15 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.info" returned: 0 in 1.063s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] snapshot: 8310165a-cce1-4044-a733-cf93d268a54b, volume: 24b9ed07-0b8c-4453-9ed0-0bf13d7379fa, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48844bd-3bde-40ed-963c-cb28b8c5de9a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:16 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b Jul 03 17:38:16 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:16 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.037s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Deleted volume successfully. Jul 03 17:38:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-83f4a8ca-c822-446e-99b4-39443ac1742b tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-954ea081-bf67-40cf-95cb-d6ab081ab514-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:17 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b" returned: 0 in 0.996s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a06ceee-87a6-48ce-b0f9-99d36619331b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:38:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:38:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:38:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b6df66-43af-4b9f-9742-dda87ea1b2ac]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:17 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:17 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:18 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 1.156s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:18 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:38:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:18 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa Jul 03 17:38:18 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:21 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-8509f50b-7202-4cb2-8fa0-8c8d1c42dda3 req-9edba214-0634-4c96-8380-d37db324807f tempest-TestInstancesWithCinderVolumes-1725704358 None] Terminate volume connection completed successfully. Jul 03 17:38:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-8509f50b-7202-4cb2-8fa0-8c8d1c42dda3 req-9edba214-0634-4c96-8380-d37db324807f tempest-TestInstancesWithCinderVolumes-1725704358 None] Deleting attachment f0936097-d267-4c44-bb17-4130e43845c4. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:38:23 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" returned: 0 in 5.162s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33095e5-5f55-4d56-894e-5d2f02fe847f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:23 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:23 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:24 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 0.891s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:38:24 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Converted 1024.00 MB image at 198.33 MB/s Jul 03 17:38:24 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa is being set with open permissions: ugo+rw Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:24 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa Jul 03 17:38:24 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "cinder-a34e50fb-c56c-447e-80e9-4bc10e20f67f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-a34e50fb-c56c-447e-80e9-4bc10e20f67f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "cinder-quobyte-a34e50fb-c56c-447e-80e9-4bc10e20f67f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-quobyte-a34e50fb-c56c-447e-80e9-4bc10e20f67f" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6037f65-b97c-4e66-9539-1d46a2e93961]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:24 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:38:24 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:24 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" returned: 0 in 0.710s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" released by "_copy_volume_from_snapshot" :: held 9.049s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-8310165a-cce1-4044-a733-cf93d268a54b" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-8310165a-cce1-4044-a733-cf93d268a54b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Deleting offline snapshot 8310165a-cce1-4044-a733-cf93d268a54b of volume 4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] snapshot_file for this snap is: volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[955efeae-3957-459c-b642-3249db1d05f4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:25 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b Jul 03 17:38:25 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:25 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 0 in 0.775s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:25 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:38:25 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:25 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a06ceee-87a6-48ce-b0f9-99d36619331b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561ba2e-602f-4af5-a33f-657d480985c3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:26 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:26 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:26 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 1 in 0.786s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:26 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f Jul 03 17:38:26 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:26 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:26 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b Jul 03 17:38:26 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:26 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a34e50fb-c56c-447e-80e9-4bc10e20f67f" returned: 0 in 0.620s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-quobyte-a34e50fb-c56c-447e-80e9-4bc10e20f67f" released by "delete_volume" :: held 2.275s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:26 devstack cinder-volume[86621]: WARNING cinder.quota [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-593455644-1933587356 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-593455644-1933587356, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:38:26 devstack cinder-volume[86621]: WARNING cinder.quota [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-593455644-1933587356 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-593455644-1933587356, it is now deprecated. Please use the default quota class for default quota. Jul 03 17:38:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Created reservations ['6a3c0186-c056-43ed-af31-417ebb6fe46e', '14b76951-4111-4e07-8297-7426afb52025', '998109af-878b-4528-81ea-f8e8514c2da6', '7bf7013b-56fd-4e09-ad62-b995a1ae8e35'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:27 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:27 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:27 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b" returned: 0 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:27 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b Jul 03 17:38:27 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:27 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Deleted volume successfully. Jul 03 17:38:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf3aa598-8f73-4a0c-ad50-6267c615785e tempest-TestInstancesWithCinderVolumes-1725704358 None] Lock "cinder-a34e50fb-c56c-447e-80e9-4bc10e20f67f-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:28 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b.8310165a-cce1-4044-a733-cf93d268a54b" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-8310165a-cce1-4044-a733-cf93d268a54b" released by "_delete_snapshot" :: held 3.041s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.332s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44bb572-ba04-4b6e-ae95-ed56661d8142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa', 'volume_size': 1, 'source_volid': '4a06ceee-87a6-48ce-b0f9-99d36619331b', 'source_volstatus': 'available'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1313bff3-54da-4d7b-9430-21879d76229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Volume volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa (24b9ed07-0b8c-4453-9ed0-0bf13d7379fa): created successfully Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1313bff3-54da-4d7b-9430-21879d76229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (e9d42755-0850-4052-bb00-5c2def43ee41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c0b2bc50-04d8-439e-b814-0616891567c2 tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (c46cd16d-8882-4bbb-ae95-7db24148c4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acce3ed5-3c19-463f-bf37-7ac4fe7a6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acce3ed5-3c19-463f-bf37-7ac4fe7a6df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-49277489',display_name='tempest-VolumesGetTest-Volume-1172223128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e00d6f-65d1-4783-8ca5-e563ee253c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:30Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070fd76c-f26b-48e4-b2d9-d1dc193e4e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070fd76c-f26b-48e4-b2d9-d1dc193e4e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d5df88-722e-4cc3-80f0-5a07091e38fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d5df88-722e-4cc3-80f0-5a07091e38fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e00d6f-65d1-4783-8ca5-e563ee253c89', 'volume_name': 'volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acee52f5-e202-47fa-9117-fe50296732a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acee52f5-e202-47fa-9117-fe50296732a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a69f26-a640-433b-b4f4-960c733823c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Volume e4e00d6f-65d1-4783-8ca5-e563ee253c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89', 'volume_size': 1} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-49277489',display_name='tempest-VolumesGetTest-Volume-1172223128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e00d6f-65d1-4783-8ca5-e563ee253c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:30Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Creating volume e4e00d6f-65d1-4783-8ca5-e563ee253c89 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:38:30 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:38:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:30 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 1073741824 Jul 03 17:38:30 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:31 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 1073741824" returned: 0 in 0.910s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:31 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 Jul 03 17:38:31 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:31 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89" returned: 0 in 0.717s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a69f26-a640-433b-b4f4-960c733823c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ca00ce-982f-4ce6-b2c2-79bffb7cb2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Volume volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 (e4e00d6f-65d1-4783-8ca5-e563ee253c89): created successfully Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ca00ce-982f-4ce6-b2c2-79bffb7cb2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (c46cd16d-8882-4bbb-ae95-7db24148c4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fa57abf7-5895-4d99-aad3-75ebe51242f9 tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:38:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-e4e00d6f-65d1-4783-8ca5-e563ee253c89-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Lock "cinder-e4e00d6f-65d1-4783-8ca5-e563ee253c89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-e4e00d6f-65d1-4783-8ca5-e563ee253c89" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-e4e00d6f-65d1-4783-8ca5-e563ee253c89" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:32 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b8167-4a09-4a3c-b0ad-92b6680b104d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:32 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 Jul 03 17:38:32 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:33 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89" returned: 0 in 0.828s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:33 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89 Jul 03 17:38:33 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[493a9d78-a909-4794-a1a5-06a2a4e45bb0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:33 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 Jul 03 17:38:33 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:33 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e4e00d6f-65d1-4783-8ca5-e563ee253c89" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-e4e00d6f-65d1-4783-8ca5-e563ee253c89" released by "delete_volume" :: held 1.583s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Created reservations ['a398b883-7ecb-4d23-ae56-05412f7d74e5', 'a392e378-a5f8-4f0f-af38-8cb7e63a7340', 'e8ce54de-373c-4d61-9963-ad2db848b0e6', '2bbb9ea0-0246-4c46-8c94-32ed1e22e70a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:34 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801" returned: 0 in 0.836s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:34 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:34 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da612b8f-c40a-4f6c-981c-d6c643a69797', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:38:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-1ee74b84-a686-4afc-95c7-12e2db771691 req-f96040eb-ab9c-4bc0-ae69-dd7f658d9621 tempest-TestServerVolumeAttachmentScenario-888534397 None] attachment_update completed successfully. Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Lock "cinder-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de9220c-1d5b-42cf-a66d-9b9165abd75f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:34 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.731s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:38:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ffb45398-fe8b-4f14-9176-364f3a06e421 tempest-VolumesGetTest-1260374467 None] Lock "cinder-e4e00d6f-65d1-4783-8ca5-e563ee253c89-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:34 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa Jul 03 17:38:34 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:35 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" returned: 0 in 0.945s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:35 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa Jul 03 17:38:35 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:36 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" returned: 0 in 0.755s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa" released by "delete_volume" :: held 1.745s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Created reservations ['3f9c931b-2545-47fc-b7c6-221f9bf3d5c6', '178d1863-e3eb-4c53-85c0-4ac3be1c1b61', '25f5e1f4-3203-442a-8965-b556fc0aa070', '0fc12d93-d41f-468b-802a-ccb600513440'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:36 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:36 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-4a06ceee-87a6-48ce-b0f9-99d36619331b-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Lock "cinder-4a06ceee-87a6-48ce-b0f9-99d36619331b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-4a06ceee-87a6-48ce-b0f9-99d36619331b" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-4a06ceee-87a6-48ce-b0f9-99d36619331b" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7febb-688c-49fc-a59f-cf7cbd5b9131]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:37 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:37 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:37 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.740s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-8cdb0673-ca94-483e-80a8-b00ea76845b7 tempest-VolumesGetTest-1260374467 None] Lock "cinder-24b9ed07-0b8c-4453-9ed0-0bf13d7379fa-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:37 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 0.800s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:37 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b Jul 03 17:38:37 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:38 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4a06ceee-87a6-48ce-b0f9-99d36619331b" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-4a06ceee-87a6-48ce-b0f9-99d36619331b" released by "delete_volume" :: held 1.510s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Created reservations ['731f583b-96b0-4469-bf15-07b814ba86bf', 'a6701edc-b3cc-4c5d-b633-361dbbd28b64', '39acc845-8746-40df-a449-2b85475673af', '6c841b80-c6cf-492b-b7bc-f131d112b589'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=84,cinder:UPDATE=113,cinder:DELETE=11,cinder:INSERT=27 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:38 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:38 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:39 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:39 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:38:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b9e697d-cf73-4c64-b5fa-595abebb63c8 tempest-VolumesGetTest-1260374467 None] Lock "cinder-4a06ceee-87a6-48ce-b0f9-99d36619331b-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (9acdffd9-24eb-4999-83fb-953de4291dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011deb4b-cdd5-44e3-bbe4-27297c32b988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011deb4b-cdd5-44e3-bbe4-27297c32b988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2111772254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59947732-5807-49b5-9e21-fb51c5bf45ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:40Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226ad38c-b84e-4c3e-8d80-e01535282684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226ad38c-b84e-4c3e-8d80-e01535282684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdc75c9-1317-41bd-ab05-c9590a7c680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdc75c9-1317-41bd-ab05-c9590a7c680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59947732-5807-49b5-9e21-fb51c5bf45ea', 'volume_name': 'volume-59947732-5807-49b5-9e21-fb51c5bf45ea', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fb0daf-5905-4d43-b83b-b5ebefbf26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fb0daf-5905-4d43-b83b-b5ebefbf26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14da9c7a-9a7a-46e3-a118-0065b2d5dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Volume 59947732-5807-49b5-9e21-fb51c5bf45ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59947732-5807-49b5-9e21-fb51c5bf45ea', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 17:38:40 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Trying to clone 59947732-5807-49b5-9e21-fb51c5bf45ea from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:38:41 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Image download 20.69 MB at 20.69 MB/s Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[110c5d25-0880-4ac8-97c7-bf595afda3a0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:41 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD Jul 03 17:38:41 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:41 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 is fetched for user 889dd268d0a64351b4d34aca40bc9c4b. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ba5e3d-3b08-43db-9ddb-c8fd58304daa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:42 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD Jul 03 17:38:42 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:42 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2111772254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59947732-5807-49b5-9e21-fb51c5bf45ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:40Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Creating volume 59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:38:42 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:38:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:42 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea 1073741824 Jul 03 17:38:42 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:43 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea 1073741824" returned: 0 in 0.981s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:43 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:43 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:43 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:43 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:44 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.739s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:38:44 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 0 in 0.854s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Attempting download of f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 59947732-5807-49b5-9e21-fb51c5bf45ea. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[43853e47-e3fb-4fcc-8ac6-591af67c188f]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:44 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33 Jul 03 17:38:44 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef52abe-a31d-410b-b591-7b0e4b6f1674]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:45 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 Jul 03 17:38:45 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:45 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:45 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33 Jul 03 17:38:45 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:45 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" returned: 0 in 0.884s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.908s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c5618b6-cd60-4675-a991-07ab12d471a4', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:38:46 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-b630b5ee-cbf4-4f8b-9bc0-5e9b5341ff20 req-104dfdce-97b3-4926-a21c-c6a73840bd49 tempest-TestServerVolumeAttachmentScenario-888534397 None] attachment_update completed successfully. Jul 03 17:38:46 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33" returned: 1 in 0.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_pob45z33' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:38:46 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b355eaaf-cb98-47bc-9583-73aa2c37271d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:46 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD Jul 03 17:38:46 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:47 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD" returned: 0 in 0.770s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:47 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] f57dcfb6-0eab-4021-8a48-1dea93bf40e3 was qcow2, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:38:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:47 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:47 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:49 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 0 in 2.175s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:49 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_1ybfvyu7devstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:38:49 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Converted 112.00 MB image at 51.46 MB/s Jul 03 17:38:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:49 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea 1G Jul 03 17:38:49 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:49 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea 1G" returned: 0 in 0.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85745d13-6fb8-44e6-b67a-152381cd4ae5]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:50 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:50 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:50 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 0 in 0.791s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:50 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:50 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:51 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 1 in 0.824s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Downloaded image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 59947732-5807-49b5-9e21-fb51c5bf45ea successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 for user 889dd268d0a64351b4d34aca40bc9c4b is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Marking volume 59947732-5807-49b5-9e21-fb51c5bf45ea as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Copying metadata from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 to 59947732-5807-49b5-9e21-fb51c5bf45ea. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Creating volume glance metadata for volume 59947732-5807-49b5-9e21-fb51c5bf45ea backed by image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14da9c7a-9a7a-46e3-a118-0065b2d5dfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59947732-5807-49b5-9e21-fb51c5bf45ea', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e6772b-5caf-4433-a8c9-d2ea0d1e9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:51 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Volume volume-59947732-5807-49b5-9e21-fb51c5bf45ea (59947732-5807-49b5-9e21-fb51c5bf45ea): created successfully Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e6772b-5caf-4433-a8c9-d2ea0d1e9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (9acdffd9-24eb-4999-83fb-953de4291dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b3fb489d-faa5-49c7-9b2f-498f96b19f8b tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=91,cinder:UPDATE=89,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (e9faa025-14d2-48c2-9d39-b53628205664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ee34e3-7540-4772-9354-5e7143eb0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ee34e3-7540-4772-9354-5e7143eb0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876791072',display_name='tempest-VolumesGetTest-Volume-212184174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043cd21f-4c2f-468e-8abb-9b64d85d8316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:53Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7066ca41-96aa-4220-a476-02600bd81010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7066ca41-96aa-4220-a476-02600bd81010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7ca693-5af9-435a-aab0-b6a9c8f1cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7ca693-5af9-435a-aab0-b6a9c8f1cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043cd21f-4c2f-468e-8abb-9b64d85d8316', 'volume_name': 'volume-043cd21f-4c2f-468e-8abb-9b64d85d8316', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dcbf25-637b-49f7-a49f-21ea30d09275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dcbf25-637b-49f7-a49f-21ea30d09275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091ae740-426d-432c-9cd0-a78586a1abb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:52 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Volume 043cd21f-4c2f-468e-8abb-9b64d85d8316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043cd21f-4c2f-468e-8abb-9b64d85d8316', 'volume_size': 1} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:38:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876791072',display_name='tempest-VolumesGetTest-Volume-212184174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043cd21f-4c2f-468e-8abb-9b64d85d8316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a9670712e8440abf32ff7847fc0c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:38:53Z,use_quota=True,user_id='889dd268d0a64351b4d34aca40bc9c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Creating volume 043cd21f-4c2f-468e-8abb-9b64d85d8316 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:38:52 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:38:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:52 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 1073741824 Jul 03 17:38:52 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-99827982-412e-4211-9fa6-abfe5907c776 req-5c18f393-2725-4247-82f4-53e82c72d13f tempest-TestServerVolumeAttachmentScenario-888534397 None] Terminate volume connection completed successfully. Jul 03 17:38:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-99827982-412e-4211-9fa6-abfe5907c776 req-5c18f393-2725-4247-82f4-53e82c72d13f tempest-TestServerVolumeAttachmentScenario-888534397 None] Deleting attachment 5c5618b6-cd60-4675-a991-07ab12d471a4. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:38:53 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 1073741824" returned: 0 in 1.053s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:54 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 Jul 03 17:38:54 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:54 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316" returned: 0 in 0.750s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091ae740-426d-432c-9cd0-a78586a1abb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043cd21f-4c2f-468e-8abb-9b64d85d8316', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7669de7f-e75c-4ded-a131-7d1a995aa491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:38:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Volume volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 (043cd21f-4c2f-468e-8abb-9b64d85d8316): created successfully Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7669de7f-e75c-4ded-a131-7d1a995aa491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:38:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Flow 'volume_create_manager' (e9faa025-14d2-48c2-9d39-b53628205664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:38:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a14c2fec-e3fb-44e6-a220-06d1e409789c tempest-VolumesGetTest-1260374467 None] Created volume successfully. Jul 03 17:38:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-043cd21f-4c2f-468e-8abb-9b64d85d8316-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Lock "cinder-043cd21f-4c2f-468e-8abb-9b64d85d8316-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-043cd21f-4c2f-468e-8abb-9b64d85d8316" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-043cd21f-4c2f-468e-8abb-9b64d85d8316" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:55 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a28e2c6-cf87-4d88-854f-8707b3a216b1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:55 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 Jul 03 17:38:55 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:56 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316" returned: 0 in 0.852s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:56 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316 Jul 03 17:38:56 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:57 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-043cd21f-4c2f-468e-8abb-9b64d85d8316" returned: 0 in 0.806s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-043cd21f-4c2f-468e-8abb-9b64d85d8316" released by "delete_volume" :: held 1.731s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-c659fd37-f2e4-4bfa-8c68-da52bd48e3a0 req-621d51f8-efa3-4c51-be4e-daea15b7cfe2 tempest-TestServerVolumeAttachmentScenario-888534397 None] Terminate volume connection completed successfully. Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-c659fd37-f2e4-4bfa-8c68-da52bd48e3a0 req-621d51f8-efa3-4c51-be4e-daea15b7cfe2 tempest-TestServerVolumeAttachmentScenario-888534397 None] Deleting attachment da612b8f-c40a-4f6c-981c-d6c643a69797. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Created reservations ['31904e4d-fa81-4bba-8013-5f8ad115f217', '4a288211-77df-4f89-bd42-b474d662d34e', '58f48827-e182-4874-bf26-2e383ee60ca3', '6d9fb8db-7fa7-4744-bfa9-9342b7cffa61'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:57 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:38:57 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-59947732-5807-49b5-9e21-fb51c5bf45ea-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Lock "cinder-59947732-5807-49b5-9e21-fb51c5bf45ea-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Acquiring lock "cinder-quobyte-59947732-5807-49b5-9e21-fb51c5bf45ea" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-59947732-5807-49b5-9e21-fb51c5bf45ea" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f3ffa8-4963-4ba6-8e16-cd6c1e5c87df]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:57 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:57 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:57 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.780s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:57 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:38:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:38:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7a04e58f-56fb-4fb8-b85a-d18eaaca8e7c tempest-VolumesGetTest-1260374467 None] Lock "cinder-043cd21f-4c2f-468e-8abb-9b64d85d8316-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:38:58 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 0 in 0.798s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:58 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:58 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:38:59 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 03 17:38:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 1 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:38:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:38:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:38:59 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea Jul 03 17:38:59 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:00 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-59947732-5807-49b5-9e21-fb51c5bf45ea" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Lock "cinder-quobyte-59947732-5807-49b5-9e21-fb51c5bf45ea" released by "delete_volume" :: held 2.507s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Created reservations ['8955d03f-7b7d-4325-81f9-bf39a965e36d', 'eac45b33-bc85-46f3-a1bf-f1147db558b5', '2c9dd410-3933-4fd1-af90-c51696053553', '38b0d02c-0b83-4029-95ed-7b2d2e043ff5'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:00 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:00 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:01 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:01 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Deleted volume successfully. Jul 03 17:39:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9f0204a8-a3de-4559-8809-60073f1d646e tempest-VolumesGetTest-1260374467 None] Lock "cinder-59947732-5807-49b5-9e21-fb51c5bf45ea-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "cinder-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Flow 'volume_create_manager' (71600894-db18-4e21-ba19-413b847a57f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2664c28c-0ce3-4275-b1d6-35e200da8d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2664c28c-0ce3-4275-b1d6-35e200da8d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1666241643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3607c6cf-b0eb-4fa3-88f2-b94406182e74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0155800a6d5410c8bc9f00cdb006be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:07Z,use_quota=True,user_id='13b4e6a1665142bda47700458490fec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd805b7-50da-4f85-b344-f7ae7cbcc0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd805b7-50da-4f85-b344-f7ae7cbcc0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc344bb-b601-40fe-ac4d-32a13ab0831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc344bb-b601-40fe-ac4d-32a13ab0831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3607c6cf-b0eb-4fa3-88f2-b94406182e74', 'volume_name': 'volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae4e6b3-a74c-4683-a8b1-730c31aeee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae4e6b3-a74c-4683-a8b1-730c31aeee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885b50ed-7c07-4d7f-b930-7772df88bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Volume 3607c6cf-b0eb-4fa3-88f2-b94406182e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74', 'volume_size': 1} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1666241643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3607c6cf-b0eb-4fa3-88f2-b94406182e74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0155800a6d5410c8bc9f00cdb006be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:07Z,use_quota=True,user_id='13b4e6a1665142bda47700458490fec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Creating volume 3607c6cf-b0eb-4fa3-88f2-b94406182e74 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:39:07 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:07 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 1073741824 Jul 03 17:39:07 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "cinder-quobyte-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-quobyte-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919705f-ac7f-4307-844f-7fa1f1a30154]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:07 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 Jul 03 17:39:07 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:07 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 1073741824" returned: 0 in 0.805s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:08 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 Jul 03 17:39:08 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:08 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:08 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8 Jul 03 17:39:08 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:08 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:08 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885b50ed-7c07-4d7f-b930-7772df88bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bea1f3-d759-43f7-be9e-1da6645e4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" returned: 0 in 0.669s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:08 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Volume volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 (3607c6cf-b0eb-4fa3-88f2-b94406182e74): created successfully Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bea1f3-d759-43f7-be9e-1da6645e4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Flow 'volume_create_manager' (71600894-db18-4e21-ba19-413b847a57f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-quobyte-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8" released by "delete_volume" :: held 1.528s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:08 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3f58a1ec-6c52-437a-9eb5-9799bdffcfaa tempest-VolumesListTestJSON-1107016527 None] Created volume successfully. Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Created reservations ['17ffd60a-b2d0-4977-b503-c6349e544937', '5c433592-6901-4650-8620-137176adc084', '89e660f5-2119-4640-a1de-d5bb8774caf1', 'df8ab2cc-7ef9-4192-8bc6-6c27f021253f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:08 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:08 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "cinder-94dd7c9b-deae-44d2-8de3-5d9d7abec801-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-94dd7c9b-deae-44d2-8de3-5d9d7abec801-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "cinder-quobyte-94dd7c9b-deae-44d2-8de3-5d9d7abec801" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-quobyte-94dd7c9b-deae-44d2-8de3-5d9d7abec801" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da433b7-f927-401c-b6ae-901f62aadfad]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:09 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.820s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Deleted volume successfully. Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3dc2753-8007-417d-88df-323bb7142c38 tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-795e4d30-1f8f-4d7c-a4ce-12c6af5932b8-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:09 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 Jul 03 17:39:09 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Flow 'volume_create_manager' (fc47792d-03a7-453c-a225-9966ccf34c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32525d4a-ebfa-4f36-ba20-c62d0021f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32525d4a-ebfa-4f36-ba20-c62d0021f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2106729433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5e8d96-2f22-4dd6-b4ea-306a70e15e76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0155800a6d5410c8bc9f00cdb006be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:10Z,use_quota=True,user_id='13b4e6a1665142bda47700458490fec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e31ce4-8aac-443d-a20e-03d5b3437b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e31ce4-8aac-443d-a20e-03d5b3437b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e3221-28f4-465e-bf3f-3ff0578b0f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e3221-28f4-465e-bf3f-3ff0578b0f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5e8d96-2f22-4dd6-b4ea-306a70e15e76', 'volume_name': 'volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba9b184-8f50-43b5-bbac-e7a2f509b0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba9b184-8f50-43b5-bbac-e7a2f509b0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441d78e0-dc14-486b-b732-031a63d3064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Volume 3a5e8d96-2f22-4dd6-b4ea-306a70e15e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76', 'volume_size': 1} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2106729433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5e8d96-2f22-4dd6-b4ea-306a70e15e76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0155800a6d5410c8bc9f00cdb006be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:10Z,use_quota=True,user_id='13b4e6a1665142bda47700458490fec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Creating volume 3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:39:10 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:10 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 1073741824 Jul 03 17:39:10 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:10 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801" returned: 0 in 1.019s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:10 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801 Jul 03 17:39:10 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:11 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 1073741824" returned: 0 in 1.036s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:11 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 Jul 03 17:39:11 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:11 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94dd7c9b-deae-44d2-8de3-5d9d7abec801" returned: 0 in 0.869s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-quobyte-94dd7c9b-deae-44d2-8de3-5d9d7abec801" released by "delete_volume" :: held 1.950s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Created reservations ['51907395-569a-4875-8295-17c4437026d9', '72fb7ae5-f454-4187-8aee-cf7392a350ef', 'ec82d7f9-d996-49b8-af0a-f3b01e50625c', '9d6f05fa-d0bb-4e4a-aac2-7c7ccf4a7bb7'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:11 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:11 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:11 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76" returned: 0 in 0.782s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441d78e0-dc14-486b-b732-031a63d3064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e040e3fb-2e98-49f5-9250-bb99a57b0634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Volume volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 (3a5e8d96-2f22-4dd6-b4ea-306a70e15e76): created successfully Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e040e3fb-2e98-49f5-9250-bb99a57b0634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Flow 'volume_create_manager' (fc47792d-03a7-453c-a225-9966ccf34c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a4f170d3-8eb7-4f31-a6e1-c3f8079c83e5 tempest-VolumesListTestJSON-1107016527 None] Created volume successfully. Jul 03 17:39:12 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.796s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:12 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:12 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Deleted volume successfully. Jul 03 17:39:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-89b3c99f-a7b8-4053-9c6d-17bfe37afabe tempest-TestServerVolumeAttachmentScenario-888534397 None] Lock "cinder-94dd7c9b-deae-44d2-8de3-5d9d7abec801-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Flow 'volume_create_manager' (81b6e3fc-58aa-49eb-9b34-e3f4be8b28b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5109d4-236e-4eaf-bdd4-c07855fd3f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5109d4-236e-4eaf-bdd4-c07855fd3f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-962880659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29166ecf-cd4c-4ee6-9bef-bf0715695f9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0155800a6d5410c8bc9f00cdb006be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:14Z,use_quota=True,user_id='13b4e6a1665142bda47700458490fec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febee758-3125-4530-8ee4-ed410576b018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febee758-3125-4530-8ee4-ed410576b018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b95716a-9114-48ed-b6d9-266afc9273f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b95716a-9114-48ed-b6d9-266afc9273f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29166ecf-cd4c-4ee6-9bef-bf0715695f9d', 'volume_name': 'volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18779b2-d658-4c80-ad98-57fe3a77bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18779b2-d658-4c80-ad98-57fe3a77bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7d27b4-509e-4f37-b6ad-c697a0155668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Volume 29166ecf-cd4c-4ee6-9bef-bf0715695f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d', 'volume_size': 1} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-962880659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29166ecf-cd4c-4ee6-9bef-bf0715695f9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0155800a6d5410c8bc9f00cdb006be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:14Z,use_quota=True,user_id='13b4e6a1665142bda47700458490fec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Creating volume 29166ecf-cd4c-4ee6-9bef-bf0715695f9d {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:39:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:39:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:13 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d 1073741824 Jul 03 17:39:13 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:14 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d 1073741824" returned: 0 in 0.994s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:14 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d Jul 03 17:39:14 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:15 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d" returned: 0 in 0.695s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7d27b4-509e-4f37-b6ad-c697a0155668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9be666b-4427-408b-89e9-306f63864a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Volume volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d (29166ecf-cd4c-4ee6-9bef-bf0715695f9d): created successfully Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9be666b-4427-408b-89e9-306f63864a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Flow 'volume_create_manager' (81b6e3fc-58aa-49eb-9b34-e3f4be8b28b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-368548c6-48ce-4744-8da1-2fd74de4f41d tempest-VolumesListTestJSON-1107016527 None] Created volume successfully. Jul 03 17:39:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "cinder-29166ecf-cd4c-4ee6-9bef-bf0715695f9d-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-29166ecf-cd4c-4ee6-9bef-bf0715695f9d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "cinder-quobyte-29166ecf-cd4c-4ee6-9bef-bf0715695f9d" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-quobyte-29166ecf-cd4c-4ee6-9bef-bf0715695f9d" acquired by "delete_volume" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea88fe-6acb-4208-8bac-f6237b2c56d9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:18 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d Jul 03 17:39:18 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:20 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d" returned: 0 in 1.423s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:20 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d Jul 03 17:39:20 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:21 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29166ecf-cd4c-4ee6-9bef-bf0715695f9d" returned: 0 in 0.898s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-quobyte-29166ecf-cd4c-4ee6-9bef-bf0715695f9d" released by "delete_volume" :: held 2.410s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Created reservations ['c48543a4-a7fc-4160-83b7-522792981e07', '41f85b72-c8d1-4129-b973-d81008a6b534', 'bfd76185-8e5f-4455-b4ee-be76b7b65022', 'deaf7c9a-517f-4a66-9f4b-3d89a2a81e0b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:21 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:21 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:22 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Deleted volume successfully. Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "cinder-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-373432ac-5d53-408c-a907-61c33ede67ce tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-29166ecf-cd4c-4ee6-9bef-bf0715695f9d-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "cinder-quobyte-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Flow 'volume_create_manager' (c55abd7b-1ab5-4d46-8911-1973e6108350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef7f19b-d8f1-4b59-9a11-7f2947ae39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-quobyte-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76" acquired by "delete_volume" :: waited 0.062s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0bc77d-8be3-4d41-8a33-d6674180f92d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef7f19b-d8f1-4b59-9a11-7f2947ae39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2103112943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62461d7-51f4-44f1-90a0-a06bb4275f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49cef376af5485197957bab4a0e80e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:22Z,use_quota=True,user_id='79b900fa61e9401e893d8c9da6f153b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4842f4-570d-4245-8866-03dfd6bd9d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4842f4-570d-4245-8866-03dfd6bd9d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a050d1-8d22-40ed-8400-f0a699487f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a050d1-8d22-40ed-8400-f0a699487f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62461d7-51f4-44f1-90a0-a06bb4275f97', 'volume_name': 'volume-a62461d7-51f4-44f1-90a0-a06bb4275f97', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4213fb46-0897-4d37-8234-e3a474f36deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4213fb46-0897-4d37-8234-e3a474f36deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746d73da-2fa8-4664-933e-5dd10f1df94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Volume a62461d7-51f4-44f1-90a0-a06bb4275f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62461d7-51f4-44f1-90a0-a06bb4275f97', 'volume_size': 1} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2103112943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62461d7-51f4-44f1-90a0-a06bb4275f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49cef376af5485197957bab4a0e80e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:22Z,use_quota=True,user_id='79b900fa61e9401e893d8c9da6f153b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Creating volume a62461d7-51f4-44f1-90a0-a06bb4275f97 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:39:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:39:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:22 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 1073741824 Jul 03 17:39:22 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:22 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 Jul 03 17:39:22 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:23 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76" returned: 0 in 0.896s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:23 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76 Jul 03 17:39:23 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:23 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 1073741824" returned: 0 in 1.179s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:23 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 Jul 03 17:39:23 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:24 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76" returned: 0 in 0.750s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-quobyte-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76" released by "delete_volume" :: held 1.698s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Created reservations ['4c65cda0-65e8-4f78-bd59-d1219b7379b3', '10365ba2-faf6-43f7-a7c4-b8e3a3a9d9d1', '4eb693bf-bb7c-4b29-b5e6-2ffc1421ccdf', '60e4ca10-756c-466b-af5e-975129580584'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:24 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:24 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:24 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97" returned: 0 in 0.820s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746d73da-2fa8-4664-933e-5dd10f1df94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62461d7-51f4-44f1-90a0-a06bb4275f97', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f7b290-51e5-40f9-afa3-963eae820cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Volume volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 (a62461d7-51f4-44f1-90a0-a06bb4275f97): created successfully Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f7b290-51e5-40f9-afa3-963eae820cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Flow 'volume_create_manager' (c55abd7b-1ab5-4d46-8911-1973e6108350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-de15a03d-34d2-4d1d-9d79-5a56f8ec4d7b tempest-TestMinimumBasicScenario-626824393 None] Created volume successfully. Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "cinder-3607c6cf-b0eb-4fa3-88f2-b94406182e74-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-3607c6cf-b0eb-4fa3-88f2-b94406182e74-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "cinder-quobyte-3607c6cf-b0eb-4fa3-88f2-b94406182e74" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:39:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-quobyte-3607c6cf-b0eb-4fa3-88f2-b94406182e74" acquired by "delete_volume" :: waited 0.042s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b45e79a-6e39-4cfc-8fb5-1fd6c63c3b94]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:25 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 Jul 03 17:39:25 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:25 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Deleted volume successfully. Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0de6f950-583b-4105-b529-5f07b0e46b5b tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-3a5e8d96-2f22-4dd6-b4ea-306a70e15e76-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:25 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74" returned: 0 in 0.938s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:26 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74 Jul 03 17:39:26 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:26 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3607c6cf-b0eb-4fa3-88f2-b94406182e74" returned: 0 in 0.707s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-quobyte-3607c6cf-b0eb-4fa3-88f2-b94406182e74" released by "delete_volume" :: held 1.694s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Created reservations ['c007123d-d26b-405b-a0db-4fb614f73158', 'bd46dce2-cc14-4e1f-87c6-ff7d7042f29a', 'ac5bdaab-cd6f-40ac-94bf-17bc94be58ba', 'd5f6d023-9782-4511-ab91-689637d80ac9'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:26 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:26 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:27 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.717s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Deleted volume successfully. Jul 03 17:39:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4f8040d-fa5e-4e44-827c-a40610daa5d2 tempest-VolumesListTestJSON-1107016527 None] Lock "cinder-3607c6cf-b0eb-4fa3-88f2-b94406182e74-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:39:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:29 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4a4f2-ffb5-4e74-af05-ab8b712447f5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:29 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 Jul 03 17:39:29 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:30 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97" returned: 0 in 0.902s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.923s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-a62461d7-51f4-44f1-90a0-a06bb4275f97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4367ea39-efc9-4377-adc6-77496c1c8bdb', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:39:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-e367af23-e892-427a-aa60-f749d9d45436 req-576d8cf0-a1ae-481c-85da-ef9749037aa1 tempest-TestMinimumBasicScenario-626824393 None] attachment_update completed successfully. Jul 03 17:39:40 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=54,cinder:INSERT=16,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:39:40 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=82,cinder:DELETE=6,cinder:SELECT=68,cinder:INSERT=25 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:43 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:39:43 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:44 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.685s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:39:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:39:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:39:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Flow 'volume_create_manager' (bccf92ad-d7df-4ce5-bab4-380459d78e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b27be2-0c8d-4e1a-ae56-8967121e7255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b27be2-0c8d-4e1a-ae56-8967121e7255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-994708426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00be10a8452b40fb9f1d64834330f4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:55Z,use_quota=True,user_id='f79d76f005614fd7a3e9d4f70213fcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec296d29-5651-49a4-8bee-d3b3f67b7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec296d29-5651-49a4-8bee-d3b3f67b7011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c108f6fd-9d29-42bc-8bdb-eda76cafa5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:54 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c108f6fd-9d29-42bc-8bdb-eda76cafa5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9', 'volume_name': 'volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639faf4d-3c3f-45ff-b39d-dd6f13ab61b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639faf4d-3c3f-45ff-b39d-dd6f13ab61b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e526a17-2753-4f23-8511-002fc703a6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:39:55 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Volume 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Trying to clone 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:39:55 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Image download 20.69 MB at 20.69 MB/s Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[37878263-990d-47a2-8833-b80d72764c8b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:55 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD Jul 03 17:39:55 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:56 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:56 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 is fetched for user f79d76f005614fd7a3e9d4f70213fcb3. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:39:56 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990b426-5864-41fd-bcc1-58a061d9a11d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:56 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD Jul 03 17:39:56 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:57 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD" returned: 0 in 0.873s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-994708426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00be10a8452b40fb9f1d64834330f4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:39:55Z,use_quota=True,user_id='f79d76f005614fd7a3e9d4f70213fcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Creating volume 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:39:57 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:39:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:57 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 1073741824 Jul 03 17:39:57 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:58 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 1073741824" returned: 0 in 1.235s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:58 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:39:58 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:39:59 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 03 17:39:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 0.805s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:39:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:39:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:39:59 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Attempting download of f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:39:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f795d97-fe1a-4b87-aa16-f19f61bfb549]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:39:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:39:59 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc Jul 03 17:39:59 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:00 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc" returned: 0 in 0.754s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:00 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc Jul 03 17:40:00 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:01 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc" returned: 1 in 0.729s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_uqltludc' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfca191-99cb-43c8-a9ab-1a09ec9b5ec5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:01 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD Jul 03 17:40:01 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:01 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] f57dcfb6-0eab-4021-8a48-1dea93bf40e3 was qcow2, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:40:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:01 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:40:01 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:03 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 1.813s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:03 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57dcfb6-0eab-4021-8a48-1dea93bf40e3_h_5du2ngdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:40:03 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Converted 112.00 MB image at 61.75 MB/s Jul 03 17:40:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:03 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 1G Jul 03 17:40:03 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:04 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 1G" returned: 0 in 0.680s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a40d5f-62da-4a34-86e0-995f7c9b7192]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:40:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:04 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:40:04 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:05 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 0.722s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:05 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:40:05 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:05 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 1 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Downloaded image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}])) to volume 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Temporary image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 for user f79d76f005614fd7a3e9d4f70213fcb3 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Marking volume 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Copying metadata from image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 to 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Creating volume glance metadata for volume 3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 backed by image f57dcfb6-0eab-4021-8a48-1dea93bf40e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e526a17-2753-4f23-8511-002fc703a6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9', 'volume_size': 1, 'image_id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8069f08564e44642bfdb4eb29b041821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57dcfb6-0eab-4021-8a48-1dea93bf40e3', 'created_at': datetime.datetime(2026, 7, 3, 15, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 17, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57dcfb6-0eab-4021-8a48-1dea93bf40e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acc40d-49cf-4337-be5a-de9093112fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Volume volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 (3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9): created successfully Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acc40d-49cf-4337-be5a-de9093112fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Flow 'volume_create_manager' (bccf92ad-d7df-4ce5-bab4-380459d78e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-19c90668-d375-4a7e-9a12-a60fdd0423da tempest-TestShelveInstance-990379062 None] Created volume successfully. Jul 03 17:40:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:13 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61fed16-9798-466f-88d9-2bec80c92a2b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:40:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:13 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:40:13 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:14 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 0.724s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:14 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:40:14 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:15 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 1 in 0.705s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:40:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.468s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04189517-c0cc-413d-a2cf-0a486a128271', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:40:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-ddb728bc-f66b-4e76-8536-995c698fe784 req-d93b411d-7dc6-4e61-b3b6-7106fc8c14fb tempest-TestShelveInstance-990379062 None] attachment_update completed successfully. Jul 03 17:40:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-ee3386c0-b0f0-47fd-bdde-27d92a123782 req-24bbbf61-374e-4da0-8c85-188939629b6e tempest-TestMinimumBasicScenario-626824393 None] Terminate volume connection completed successfully. Jul 03 17:40:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-ee3386c0-b0f0-47fd-bdde-27d92a123782 req-24bbbf61-374e-4da0-8c85-188939629b6e tempest-TestMinimumBasicScenario-626824393 None] Deleting attachment 4367ea39-efc9-4377-adc6-77496c1c8bdb. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:40:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Acquiring lock "cinder-a62461d7-51f4-44f1-90a0-a06bb4275f97-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:40:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Lock "cinder-a62461d7-51f4-44f1-90a0-a06bb4275f97-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:40:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Acquiring lock "cinder-quobyte-a62461d7-51f4-44f1-90a0-a06bb4275f97" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:40:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Lock "cinder-quobyte-a62461d7-51f4-44f1-90a0-a06bb4275f97" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:40:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa0261-8c9c-46f5-bdec-600987845817]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:40:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:25 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 Jul 03 17:40:25 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:26 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97" returned: 0 in 0.850s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:26 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97 Jul 03 17:40:26 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:27 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a62461d7-51f4-44f1-90a0-a06bb4275f97" returned: 0 in 0.676s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Lock "cinder-quobyte-a62461d7-51f4-44f1-90a0-a06bb4275f97" released by "delete_volume" :: held 1.581s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Created reservations ['b96ee71f-6469-4b32-a49b-17f7b80b2a44', 'c4b6b870-6d7b-4eb5-83fe-c7bbfa008c7d', '30808609-ede3-4ae3-96e7-656ba009827e', '9048da4f-8828-4d93-b9e8-260712f0bac4'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:27 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:40:27 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:27 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.680s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:40:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Deleted volume successfully. Jul 03 17:40:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e909b0dc-5843-4c0f-863d-092ec1efd63c tempest-TestMinimumBasicScenario-626824393 None] Lock "cinder-a62461d7-51f4-44f1-90a0-a06bb4275f97-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:40:37 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=15,cinder:SELECT=21,cinder:INSERT=6 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:40:37 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=21,cinder:INSERT=12,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:43 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:40:43 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:44 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.680s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:40:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:40:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:40:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (9b3cbd7f-9005-4c6a-ba5d-10f614fd264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7f6b82-6c93-44fd-ae7a-48609c316675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7f6b82-6c93-44fd-ae7a-48609c316675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838484871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:45Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9659efe0-1712-4671-9065-eb1e761a96a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9659efe0-1712-4671-9065-eb1e761a96a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee972a0b-d851-44c3-85f8-b2966e53dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee972a0b-d851-44c3-85f8-b2966e53dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd', 'volume_name': 'volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17920548-8f9a-4cc2-9a2e-ae2e1737fe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17920548-8f9a-4cc2-9a2e-ae2e1737fe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ccd49a-d309-46c6-aaf4-9c85c9dc9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:45 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd', 'volume_size': 1} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838484871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:45Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating volume c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:40:45 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:40:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:45 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd 1073741824 Jul 03 17:40:45 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:46 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd 1073741824" returned: 0 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:46 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd Jul 03 17:40:46 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:47 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ccd49a-d309-46c6-aaf4-9c85c9dc9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92053d6a-c7fa-4548-8eb7-7e3ab2357100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:47 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd (c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd): created successfully Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92053d6a-c7fa-4548-8eb7-7e3ab2357100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (9b3cbd7f-9005-4c6a-ba5d-10f614fd264e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e1da2559-a76a-42cc-bc9a-c1fc6fe66785 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created volume successfully. Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating offline snapshot 96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 of volume c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8393c8-ca5e-457b-8fc8-bdd62f641926]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:40:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:47 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd Jul 03 17:40:47 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:48 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" returned: 0 in 1.003s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:48 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 1G Jul 03 17:40:48 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:49 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 1G" returned: 0 in 1.007s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:49 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 Jul 03 17:40:49 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:50 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:50 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 is being set with open permissions: ugo+rw Jul 03 17:40:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:50 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 Jul 03 17:40:50 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:51 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" returned: 0 in 0.635s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:51 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info Jul 03 17:40:51 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:51 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info" returned: 0 in 0.662s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:51 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info is being set with open permissions: ugo+rw Jul 03 17:40:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:51 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info Jul 03 17:40:51 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:52 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.info" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-da4abea6-6162-41ff-a61a-428085406ab4 tempest-CreateVolumesFromSnapshotTest-124049696 None] Create snapshot completed successfully Jul 03 17:40:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-ca45315c-b420-4668-af27-5bcd4da03993 req-648c4895-cbd7-4fb0-a0ab-23bae3f09543 tempest-TestShelveInstance-990379062 None] Terminate volume connection completed successfully. Jul 03 17:40:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-ca45315c-b420-4668-af27-5bcd4da03993 req-648c4895-cbd7-4fb0-a0ab-23bae3f09543 tempest-TestShelveInstance-990379062 None] Deleting attachment 04189517-c0cc-413d-a2cf-0a486a128271. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (b0d1af2f-b16d-4779-b37e-2d792c89d837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d92a682-5462-4673-815b-537c48066aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d92a682-5462-4673-815b-537c48066aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999993128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6b8f33-1062-4346-955d-6fd2907be3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:53Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca909e6-7449-44f3-bfeb-1b277a78e123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca909e6-7449-44f3-bfeb-1b277a78e123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1bfdfe-8ead-4c30-943e-9bf8d8b05921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1bfdfe-8ead-4c30-943e-9bf8d8b05921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6b8f33-1062-4346-955d-6fd2907be3de', 'volume_name': 'volume-5d6b8f33-1062-4346-955d-6fd2907be3de', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74cc703-6198-45f2-a9ba-f362ab8ffdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74cc703-6198-45f2-a9ba-f362ab8ffdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7c824d-20bf-4cda-b26c-2d080d20c41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume 5d6b8f33-1062-4346-955d-6fd2907be3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6b8f33-1062-4346-955d-6fd2907be3de', 'volume_size': 1} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999993128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6b8f33-1062-4346-955d-6fd2907be3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:53Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating volume 5d6b8f33-1062-4346-955d-6fd2907be3de {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:40:53 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:53 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de 1073741824 Jul 03 17:40:53 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (709fa500-57a8-43a6-b257-cff9d28fa6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bae020-eeea-43a6-bdee-8e3c50d1e64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bae020-eeea-43a6-bdee-8e3c50d1e64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839489916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce762160-14e8-4da2-aae8-7c8351c131f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:54Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae7458e-809d-429a-b08f-9805b23e5995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae7458e-809d-429a-b08f-9805b23e5995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15950ce-f7bd-46eb-af52-812809c1be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15950ce-f7bd-46eb-af52-812809c1be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce762160-14e8-4da2-aae8-7c8351c131f4', 'volume_name': 'volume-ce762160-14e8-4da2-aae8-7c8351c131f4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0117c666-9c0a-49ee-9ae6-419bda4b1027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0117c666-9c0a-49ee-9ae6-419bda4b1027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2164054-44eb-4f80-8c7f-6dcbda572413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:53 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume ce762160-14e8-4da2-aae8-7c8351c131f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce762160-14e8-4da2-aae8-7c8351c131f4', 'volume_size': 1} Jul 03 17:40:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (0a6e3606-60f0-45bc-aa31-77751434bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4750f020-b9b6-4632-8981-79606371874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4750f020-b9b6-4632-8981-79606371874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724601686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac86b23-bd84-48c9-821c-7a3d67fbc25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:54Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bc5ee4-caa3-42a2-a867-42082634171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bc5ee4-caa3-42a2-a867-42082634171d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da5229-5e87-4b51-81eb-4d29a6e7a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da5229-5e87-4b51-81eb-4d29a6e7a98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac86b23-bd84-48c9-821c-7a3d67fbc25a', 'volume_name': 'volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381d2f9e-5f30-452f-811c-170ad6421db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381d2f9e-5f30-452f-811c-170ad6421db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a16bb8-4cbc-4855-a713-9bf0a0721a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume 3ac86b23-bd84-48c9-821c-7a3d67fbc25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a', 'volume_size': 1} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:54 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de 1073741824" returned: 0 in 1.024s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:54 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de Jul 03 17:40:54 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (17b8a9ee-afd4-442e-bb8d-7cd9a478717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cd8260-d029-472c-963e-3786f2c3034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cd8260-d029-472c-963e-3786f2c3034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611873964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05355c11-5ae8-4ef6-9450-f9769784d26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:55Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63ad2dd-5658-45e8-b652-94633e264f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63ad2dd-5658-45e8-b652-94633e264f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc60a7f-e107-4732-9926-b664e20e2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc60a7f-e107-4732-9926-b664e20e2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05355c11-5ae8-4ef6-9450-f9769784d26f', 'volume_name': 'volume-05355c11-5ae8-4ef6-9450-f9769784d26f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ff024b-09f2-4bca-ad7f-ac424fb91b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ff024b-09f2-4bca-ad7f-ac424fb91b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1508bf9-5809-420e-8e90-56b2a167f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume 05355c11-5ae8-4ef6-9450-f9769784d26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05355c11-5ae8-4ef6-9450-f9769784d26f', 'volume_size': 1} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (92358e2c-a160-4da3-bb9f-a1c52f1b546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7954c9-4647-4745-a3af-e463c7fb3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7954c9-4647-4745-a3af-e463c7fb3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1433493491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0a16b9-4f28-4e20-a86e-2ef344994a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:55Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b59559-7659-4898-a6e4-3ec66a5b3d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b59559-7659-4898-a6e4-3ec66a5b3d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d825d19-6d1f-467a-b90c-0c69c9026a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d825d19-6d1f-467a-b90c-0c69c9026a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0a16b9-4f28-4e20-a86e-2ef344994a38', 'volume_name': 'volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0e2e12-9f2c-442f-8c65-e8973a35f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0e2e12-9f2c-442f-8c65-e8973a35f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f67258-30b6-4224-8613-24b7e799f64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:55 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume 0c0a16b9-4f28-4e20-a86e-2ef344994a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38', 'volume_size': 1} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:55 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839489916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce762160-14e8-4da2-aae8-7c8351c131f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:54Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating volume ce762160-14e8-4da2-aae8-7c8351c131f4 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:40:55 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:55 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 1073741824 Jul 03 17:40:55 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7c824d-20bf-4cda-b26c-2d080d20c41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6b8f33-1062-4346-955d-6fd2907be3de', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d31fa17-2359-44fc-82a8-5534c5825082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:55 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume volume-5d6b8f33-1062-4346-955d-6fd2907be3de (5d6b8f33-1062-4346-955d-6fd2907be3de): created successfully Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d31fa17-2359-44fc-82a8-5534c5825082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:55 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (b0d1af2f-b16d-4779-b37e-2d792c89d837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:55 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-357f799c-167f-45c1-bb69-b14de677a6d0 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created volume successfully. Jul 03 17:40:56 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 1073741824" returned: 0 in 0.893s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:56 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 Jul 03 17:40:56 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:56 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4" returned: 0 in 0.661s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724601686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac86b23-bd84-48c9-821c-7a3d67fbc25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:54Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating volume 3ac86b23-bd84-48c9-821c-7a3d67fbc25a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:40:56 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:56 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a 1073741824 Jul 03 17:40:56 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2164054-44eb-4f80-8c7f-6dcbda572413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce762160-14e8-4da2-aae8-7c8351c131f4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1c955c-90f1-4da0-aa4d-e963d06f2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:56 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume volume-ce762160-14e8-4da2-aae8-7c8351c131f4 (ce762160-14e8-4da2-aae8-7c8351c131f4): created successfully Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1c955c-90f1-4da0-aa4d-e963d06f2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (709fa500-57a8-43a6-b257-cff9d28fa6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:56 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7b8c96b7-ef65-45d1-9a6c-4d909eaa69f8 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created volume successfully. Jul 03 17:40:57 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a 1073741824" returned: 0 in 1.022s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:57 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a Jul 03 17:40:57 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:58 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a" returned: 0 in 0.665s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611873964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05355c11-5ae8-4ef6-9450-f9769784d26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:55Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating volume 05355c11-5ae8-4ef6-9450-f9769784d26f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:40:58 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a16bb8-4cbc-4855-a713-9bf0a0721a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efdf20f-fd25-45e3-8fd5-ec4d09c70b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:40:58 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f 1073741824 Jul 03 17:40:58 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:58 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a (3ac86b23-bd84-48c9-821c-7a3d67fbc25a): created successfully Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efdf20f-fd25-45e3-8fd5-ec4d09c70b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (0a6e3606-60f0-45bc-aa31-77751434bce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:40:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a18b5f60-7282-4c15-86fe-c09b1b194c81 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created volume successfully. Jul 03 17:40:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:59 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f 1073741824" returned: 0 in 0.831s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:59 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f Jul 03 17:40:59 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:40:59 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f" returned: 0 in 0.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.955s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1433493491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0a16b9-4f28-4e20-a86e-2ef344994a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937b846da14647a6840aa0a2483dedda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:40:55Z,use_quota=True,user_id='a28d7b5a0808476db2fafc05f6637469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Creating volume 0c0a16b9-4f28-4e20-a86e-2ef344994a38 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:40:59 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:40:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:40:59 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 1073741824 Jul 03 17:41:00 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1508bf9-5809-420e-8e90-56b2a167f928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05355c11-5ae8-4ef6-9450-f9769784d26f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1080f141-71f8-4935-870e-5c14f3f9b415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:00 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume volume-05355c11-5ae8-4ef6-9450-f9769784d26f (05355c11-5ae8-4ef6-9450-f9769784d26f): created successfully Jul 03 17:41:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1080f141-71f8-4935-870e-5c14f3f9b415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (17b8a9ee-afd4-442e-bb8d-7cd9a478717a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5cfb8c7c-1ce0-4834-a3fb-3d9c76a4b409 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created volume successfully. Jul 03 17:41:00 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 1073741824" returned: 0 in 0.790s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:00 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 Jul 03 17:41:00 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:01 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38" returned: 0 in 0.618s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.819s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f67258-30b6-4224-8613-24b7e799f64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a87a18-e8be-4e9b-8b14-3ba508f95f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:01 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Volume volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 (0c0a16b9-4f28-4e20-a86e-2ef344994a38): created successfully Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a87a18-e8be-4e9b-8b14-3ba508f95f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Flow 'volume_create_manager' (92358e2c-a160-4da3-bb9f-a1c52f1b546f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da1190-b960-413a-a783-b98096e70d10]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ed57af62-5d3f-4513-8813-b1311b4060de tempest-CreateVolumesFromSnapshotTest-124049696 None] Created volume successfully. Jul 03 17:41:01 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:41:01 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-0c0a16b9-4f28-4e20-a86e-2ef344994a38-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-0c0a16b9-4f28-4e20-a86e-2ef344994a38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-0c0a16b9-4f28-4e20-a86e-2ef344994a38" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-0c0a16b9-4f28-4e20-a86e-2ef344994a38" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15e212-e54d-44b4-9edb-e884eb9f34f2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:01 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 Jul 03 17:41:01 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:02 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 0.730s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:02 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:41:02 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:02 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38" returned: 0 in 0.742s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:02 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38 Jul 03 17:41:02 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:02 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 1 in 0.735s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.517s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:02 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94707ff7-b358-40a6-853a-eb53b5ea49c6', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:41:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-3eedb8ea-371f-46ca-9db5-468514711fc7 req-e90a4aa3-91d5-41cc-97a7-f9763492a051 tempest-TestShelveInstance-990379062 None] attachment_update completed successfully. Jul 03 17:41:03 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0c0a16b9-4f28-4e20-a86e-2ef344994a38" returned: 0 in 0.633s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-0c0a16b9-4f28-4e20-a86e-2ef344994a38" released by "delete_volume" :: held 1.414s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['07e608eb-6436-421d-b439-8b22707dfc0e', '257842d6-f44c-4401-8133-45d5170f02ad', 'f68d0b31-2ffe-4e6f-b4bf-9d18f7f23039', '57f17373-588d-4958-864f-edb56da05e67'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:03 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:03 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:03 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-05355c11-5ae8-4ef6-9450-f9769784d26f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleted volume successfully. Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-05355c11-5ae8-4ef6-9450-f9769784d26f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0daea73c-32ea-4016-a666-6e1315c7084b tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-0c0a16b9-4f28-4e20-a86e-2ef344994a38-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-05355c11-5ae8-4ef6-9450-f9769784d26f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-05355c11-5ae8-4ef6-9450-f9769784d26f" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b1482-0a8b-4813-b24d-bdf59ce357b5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:04 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f Jul 03 17:41:04 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:04 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:04 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f Jul 03 17:41:04 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:05 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-05355c11-5ae8-4ef6-9450-f9769784d26f" returned: 0 in 0.622s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-05355c11-5ae8-4ef6-9450-f9769784d26f" released by "delete_volume" :: held 1.404s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['dab64041-22d7-455d-a63f-542213c003bf', '36c793a4-0187-45ec-b090-3761435bda3c', 'd0d384b1-9e13-4482-a079-a6bea96dbfa4', 'f123fb2c-628a-415f-8e09-1a4f29eb857b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:05 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:05 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-3ac86b23-bd84-48c9-821c-7a3d67fbc25a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:06 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.637s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleted volume successfully. Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-3ac86b23-bd84-48c9-821c-7a3d67fbc25a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-745a7d05-4f91-4da6-bbb0-779bd52be32f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-05355c11-5ae8-4ef6-9450-f9769784d26f-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-3ac86b23-bd84-48c9-821c-7a3d67fbc25a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-3ac86b23-bd84-48c9-821c-7a3d67fbc25a" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01c5ae-a05e-4ea5-b74b-53c728fee8a8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:06 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a Jul 03 17:41:06 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:06 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a" returned: 0 in 0.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:06 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a Jul 03 17:41:06 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:07 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3ac86b23-bd84-48c9-821c-7a3d67fbc25a" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-3ac86b23-bd84-48c9-821c-7a3d67fbc25a" released by "delete_volume" :: held 1.420s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['6caa1a2e-d0ad-45d7-8431-e10593086166', '4bf13b5c-1298-434c-a61c-ee3e8832eb51', '33c0fb2b-89a5-4c7a-b1f5-33ed4cd51003', '4521837c-dda9-4766-a291-7c91d6d4dfe6'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:07 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:07 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-ce762160-14e8-4da2-aae8-7c8351c131f4-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-ce762160-14e8-4da2-aae8-7c8351c131f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:08 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.702s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:08 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleted volume successfully. Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-ce762160-14e8-4da2-aae8-7c8351c131f4" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-ce762160-14e8-4da2-aae8-7c8351c131f4" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-605d1aac-48eb-4bd1-a170-6cf5dc02725d tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-3ac86b23-bd84-48c9-821c-7a3d67fbc25a-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a312e2-698a-4571-84ca-e113c97ce5a8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:08 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 Jul 03 17:41:08 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:09 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4" returned: 0 in 0.754s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:09 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4 Jul 03 17:41:09 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:09 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ce762160-14e8-4da2-aae8-7c8351c131f4" returned: 0 in 0.642s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-ce762160-14e8-4da2-aae8-7c8351c131f4" released by "delete_volume" :: held 1.438s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['149cd21e-219d-490e-98e5-5eb7cb54b242', '2fd5f2eb-1c26-4d96-8629-9896e28e0558', '753eecb9-b466-4916-82da-50067d2d98e7', '33ce73a3-49f9-4daf-a010-cc0b7acbe9f5'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:10 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:10 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-5d6b8f33-1062-4346-955d-6fd2907be3de-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-5d6b8f33-1062-4346-955d-6fd2907be3de-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:10 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.726s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleted volume successfully. Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-5d6b8f33-1062-4346-955d-6fd2907be3de" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f46ede5c-cf79-42ca-839d-dbd8b2d11bfb tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-ce762160-14e8-4da2-aae8-7c8351c131f4-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-5d6b8f33-1062-4346-955d-6fd2907be3de" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4a5afb-4e4d-4aa7-b753-ec8b6271950d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:10 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de Jul 03 17:41:10 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:11 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de" returned: 0 in 0.732s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:11 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de Jul 03 17:41:11 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:12 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5d6b8f33-1062-4346-955d-6fd2907be3de" returned: 0 in 0.636s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-5d6b8f33-1062-4346-955d-6fd2907be3de" released by "delete_volume" :: held 1.410s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['f815a3fe-5582-4e74-ad20-3b632f6afadf', '38a07eab-54eb-483d-9c9d-82e9d6eee58b', 'ff24ac9d-7bbd-4a3b-b416-b200e6374c92', '09254dfc-44ee-44e5-a7ab-9e1e2ddb1b4f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:12 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:12 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:12 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.638s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:12 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleted volume successfully. Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleting offline snapshot 96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 of volume c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] snapshot_file for this snap is: volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-398be263-1151-4eb4-8f50-29b826dfc915 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-5d6b8f33-1062-4346-955d-6fd2907be3de-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd158f-bbca-43bb-9e70-249cbf927e0b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:13 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 Jul 03 17:41:13 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:14 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" returned: 0 in 1.041s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:41:14 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e74cd7-62d8-4278-a21f-97b43d826b3b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:14 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd Jul 03 17:41:14 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:14 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" returned: 0 in 0.814s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:14 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 Jul 03 17:41:14 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:15 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" returned: 0 in 0.816s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:15 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38 Jul 03 17:41:15 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:16 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd.96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" returned: 0 in 0.723s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38" released by "_delete_snapshot" :: held 3.526s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" released by "delete_snapshot" :: held 3.553s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:16 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['e1d6814f-1726-4b4f-9f89-3f69597c3065', '8f461637-e206-4842-a3f0-f001454fbd1b', '9fef928c-c213-48a9-8f57-084499569210', 'e53eaffd-0775-4865-828c-65cfe914d64c'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Delete snapshot completed successfully. Jul 03 17:41:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-993dac55-2f8d-46b4-93d6-6fd2f13db18f tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-96f0a5ad-2934-4dcd-ae0a-0abbe06f6d38-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "cinder-quobyte-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:17 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e55bee-21cf-41f8-8a60-01daf15b7fd3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:17 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd Jul 03 17:41:17 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:18 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" returned: 0 in 0.773s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:18 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd Jul 03 17:41:18 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:18 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" returned: 0 in 0.659s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-quobyte-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd" released by "delete_volume" :: held 1.495s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Created reservations ['27390d5a-8511-4b09-956b-d457c5bc0f65', '104f70aa-e135-42ff-8ed4-8fefa3dac9a3', '29e74ab5-c6dd-4af9-8aac-1a0221493ad7', 'bb020b65-e9b6-4521-81a2-fad6eab2cbaf'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:18 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:18 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:19 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.629s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:19 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:19 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Deleted volume successfully. Jul 03 17:41:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cb411ee6-180d-4680-88a9-8bbaff46d228 tempest-CreateVolumesFromSnapshotTest-124049696 None] Lock "cinder-c7d436f7-10ac-4d02-9dfa-aaf14eea3bfd-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Flow 'volume_create_manager' (5c1d98d6-83b3-46c1-9d67-46f4d80eea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5032d61-2072-4268-a519-093cfb96012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5032d61-2072-4268-a519-093cfb96012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375306015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b58c8e-771e-43eb-8113-2ff8614e5fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327789b4609240aa978bf2c2f5508da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:41:22Z,use_quota=True,user_id='e9c939640d784f9db889c664c6cf8dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d505af8b-7ba2-4de4-8d25-87c2a5c27c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d505af8b-7ba2-4de4-8d25-87c2a5c27c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6f1319-c5f9-4c64-a230-58d2d7996bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6f1319-c5f9-4c64-a230-58d2d7996bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b58c8e-771e-43eb-8113-2ff8614e5fbe', 'volume_name': 'volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9407075a-0e1b-4240-9160-bde455dd5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9407075a-0e1b-4240-9160-bde455dd5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1ddba4-be48-4b23-bdce-0f141526b1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Volume 29b58c8e-771e-43eb-8113-2ff8614e5fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe', 'volume_size': 1} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375306015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b58c8e-771e-43eb-8113-2ff8614e5fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327789b4609240aa978bf2c2f5508da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:41:22Z,use_quota=True,user_id='e9c939640d784f9db889c664c6cf8dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Creating volume 29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:41:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:41:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:22 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe 1073741824 Jul 03 17:41:22 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:23 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe 1073741824" returned: 0 in 0.796s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:23 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:23 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:23 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1ddba4-be48-4b23-bdce-0f141526b1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1bb0bd-df8b-456d-93c2-17ad92de4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:23 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Volume volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe (29b58c8e-771e-43eb-8113-2ff8614e5fbe): created successfully Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1bb0bd-df8b-456d-93c2-17ad92de4504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Flow 'volume_create_manager' (5c1d98d6-83b3-46c1-9d67-46f4d80eea28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a809003e-63d4-4e26-ae6b-accfca3543d4 tempest-VolumeDependencyTests-1696366856 None] Created volume successfully. Jul 03 17:41:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Creating offline snapshot 911751b7-f810-489f-ae88-90d20de3aaca of volume 29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:41:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c95540-10f6-450b-ae08-71371e4a412d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:24 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:24 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:25 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 0.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:25 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca 1G Jul 03 17:41:25 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:26 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca 1G" returned: 0 in 0.798s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:26 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca Jul 03 17:41:26 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:26 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca" returned: 0 in 0.675s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:26 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca is being set with open permissions: ugo+rw Jul 03 17:41:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:26 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca Jul 03 17:41:26 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:27 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca" returned: 0 in 0.622s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:27 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info Jul 03 17:41:27 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:27 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:27 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info is being set with open permissions: ugo+rw Jul 03 17:41:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:28 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info Jul 03 17:41:28 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:28 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.info" returned: 0 in 0.637s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.217s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9de6d913-c81b-484f-a516-dc3f9e1d1eac tempest-VolumeDependencyTests-1696366856 None] Create snapshot completed successfully Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Flow 'volume_create_manager' (d6bbfdfb-394e-411c-9b99-f9ef105a3362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab8f286-bc03-4d1d-bcd7-77c0fc26e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab8f286-bc03-4d1d-bcd7-77c0fc26e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1923417299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2dd6de-e7b8-4de1-8640-8966a7923e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327789b4609240aa978bf2c2f5508da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=911751b7-f810-489f-ae88-90d20de3aaca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:41:30Z,use_quota=True,user_id='e9c939640d784f9db889c664c6cf8dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1886da25-0b46-4453-ad51-90ff1dc05b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1886da25-0b46-4453-ad51-90ff1dc05b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae978fc8-66e3-4053-af68-59fd7eaf8dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae978fc8-66e3-4053-af68-59fd7eaf8dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df2dd6de-e7b8-4de1-8640-8966a7923e4e', 'volume_name': 'volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e', 'volume_size': 1, 'snapshot_id': '911751b7-f810-489f-ae88-90d20de3aaca'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e4d8fd-525f-45a8-8938-9561191ceb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e4d8fd-525f-45a8-8938-9561191ceb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38bee52-af36-4979-a3c7-0c987df07b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Volume df2dd6de-e7b8-4de1-8640-8966a7923e4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e', 'volume_size': 1, 'snapshot_id': '911751b7-f810-489f-ae88-90d20de3aaca'} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-quobyte-911751b7-f810-489f-ae88-90d20de3aaca-df2dd6de-e7b8-4de1-8640-8966a7923e4e" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-911751b7-f810-489f-ae88-90d20de3aaca-df2dd6de-e7b8-4de1-8640-8966a7923e4e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Creating volume df2dd6de-e7b8-4de1-8640-8966a7923e4e from snapshot 911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-quobyte-df2dd6de-e7b8-4de1-8640-8966a7923e4e" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-df2dd6de-e7b8-4de1-8640-8966a7923e4e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] snapshot: 911751b7-f810-489f-ae88-90d20de3aaca, volume: df2dd6de-e7b8-4de1-8640-8966a7923e4e, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b64781e-b945-4356-9009-7526b1dd4a90]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:30 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca Jul 03 17:41:30 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:30 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca" returned: 0 in 0.728s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6455d53-ea00-4a69-a177-2eb3f7cb6e0c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:31 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:31 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:31 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 0.743s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:31 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:41:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:31 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e Jul 03 17:41:31 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:36 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e" returned: 0 in 4.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[905aa4c5-81e8-40cd-8097-8c3b91264a5f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:36 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:36 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:37 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 0.885s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:37 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:41:37 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Converted 1024.00 MB image at 213.25 MB/s Jul 03 17:41:37 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e is being set with open permissions: ugo+rw Jul 03 17:41:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:37 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e Jul 03 17:41:37 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:38 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e" returned: 0 in 0.622s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-df2dd6de-e7b8-4de1-8640-8966a7923e4e" released by "_copy_volume_from_snapshot" :: held 7.858s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-911751b7-f810-489f-ae88-90d20de3aaca-df2dd6de-e7b8-4de1-8640-8966a7923e4e" released by "_create_volume_from_snapshot" :: held 7.885s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.899s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=76,cinder:UPDATE=84,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=56,cinder:UPDATE=77,cinder:DELETE=8,cinder:INSERT=21 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38bee52-af36-4979-a3c7-0c987df07b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e', 'volume_size': 1, 'snapshot_id': '911751b7-f810-489f-ae88-90d20de3aaca'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6fb494-589d-46db-a2f9-ff5c3a4dd442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Volume volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e (df2dd6de-e7b8-4de1-8640-8966a7923e4e): created successfully Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6fb494-589d-46db-a2f9-ff5c3a4dd442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Flow 'volume_create_manager' (d6bbfdfb-394e-411c-9b99-f9ef105a3362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e4deafc1-d41b-4c6a-9c19-80bfec1e1a14 tempest-VolumeDependencyTests-1696366856 None] Created volume successfully. Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-911751b7-f810-489f-ae88-90d20de3aaca-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-911751b7-f810-489f-ae88-90d20de3aaca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-quobyte-29b58c8e-771e-43eb-8113-2ff8614e5fbe" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-29b58c8e-771e-43eb-8113-2ff8614e5fbe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-quobyte-911751b7-f810-489f-ae88-90d20de3aaca" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-911751b7-f810-489f-ae88-90d20de3aaca" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Deleting offline snapshot 911751b7-f810-489f-ae88-90d20de3aaca of volume 29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] snapshot_file for this snap is: volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff3237-2de1-4c74-9f86-456def921d72]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:38 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca Jul 03 17:41:38 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:39 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca" returned: 0 in 0.747s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:41:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd400726-ed12-4561-8a06-6815e76e4cb3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:39 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:39 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:40 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 1.151s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:40 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca Jul 03 17:41:40 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:41 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca" returned: 0 in 0.813s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:41 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca Jul 03 17:41:41 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:42 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe.911751b7-f810-489f-ae88-90d20de3aaca" returned: 0 in 0.645s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-911751b7-f810-489f-ae88-90d20de3aaca" released by "_delete_snapshot" :: held 3.449s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-29b58c8e-771e-43eb-8113-2ff8614e5fbe" released by "delete_snapshot" :: held 3.469s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:42 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Created reservations ['fd3a4bdd-6064-4272-8dcf-c2d1987e09eb', '11497fb9-763f-4d5f-9471-b2684f4ec52e', '792dd508-fc78-4313-bdc9-5b2fe5cf7112', '15ed8ece-4c49-46f0-9893-1db177d0cd20'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Delete snapshot completed successfully. Jul 03 17:41:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-589189a6-e0c1-4fe3-a1a5-6eba83ac774d tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-911751b7-f810-489f-ae88-90d20de3aaca-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-29b58c8e-771e-43eb-8113-2ff8614e5fbe-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-29b58c8e-771e-43eb-8113-2ff8614e5fbe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-quobyte-29b58c8e-771e-43eb-8113-2ff8614e5fbe" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-29b58c8e-771e-43eb-8113-2ff8614e5fbe" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72347dd-39e2-4405-bee7-ccc0606ba77b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-cbb700df-871a-454d-9f6f-93853451172e req-e0226c79-8d6d-410c-819f-f80db175a658 tempest-TestShelveInstance-990379062 None] Terminate volume connection completed successfully. Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-cbb700df-871a-454d-9f6f-93853451172e req-e0226c79-8d6d-410c-819f-f80db175a658 tempest-TestShelveInstance-990379062 None] Deleting attachment 94707ff7-b358-40a6-853a-eb53b5ea49c6. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:41:43 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:43 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Acquiring lock "cinder-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Lock "cinder-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:43 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:43 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Acquiring lock "cinder-quobyte-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Lock "cinder-quobyte-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:43 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 0.793s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ecebb-6bcb-4272-b5db-a1cba3ab3883]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:43 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe Jul 03 17:41:43 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:44 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:41:44 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:44 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.699s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:41:44 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-29b58c8e-771e-43eb-8113-2ff8614e5fbe" returned: 0 in 0.764s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-29b58c8e-771e-43eb-8113-2ff8614e5fbe" released by "delete_volume" :: held 1.616s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Created reservations ['41e1cf4d-a794-4ca3-8f3a-ee9a1e419325', '773ec564-6c03-47a2-bd02-d6929e49cddd', 'e8f5e926-b8a7-439b-bbb5-ef4e3b8cd8bd', 'b7edb551-c3be-475e-9ba6-95b5ed18f0b3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:44 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 0.808s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:44 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:44 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:44 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:41:44 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-df2dd6de-e7b8-4de1-8640-8966a7923e4e-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-df2dd6de-e7b8-4de1-8640-8966a7923e4e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "cinder-quobyte-df2dd6de-e7b8-4de1-8640-8966a7923e4e" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-df2dd6de-e7b8-4de1-8640-8966a7923e4e" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1298ffb-a756-43ca-b355-ff8775c5304c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:45 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e Jul 03 17:41:45 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:45 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.697s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Deleted volume successfully. Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e4a5d684-0344-4769-be4e-11eed4dacfd8 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-29b58c8e-771e-43eb-8113-2ff8614e5fbe-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:45 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 1 in 0.821s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:41:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:45 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9 Jul 03 17:41:45 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:46 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e" returned: 0 in 0.776s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:46 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e Jul 03 17:41:46 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:46 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" returned: 0 in 0.634s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Lock "cinder-quobyte-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9" released by "delete_volume" :: held 2.342s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.quota [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Created reservations ['a056b520-9946-423f-937f-e83b08280383', '1a8c2448-2971-41a7-887c-430f6680922d', '59c1b3cb-7cab-42f8-a34b-c80516048bc7', '26d94f43-9849-4e6c-815c-d1e7f9305412'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:46 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:46 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:46 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-df2dd6de-e7b8-4de1-8640-8966a7923e4e" returned: 0 in 0.678s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-quobyte-df2dd6de-e7b8-4de1-8640-8966a7923e4e" released by "delete_volume" :: held 1.498s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Created reservations ['3f856e45-9fa1-4806-8eb0-9cff98f453b9', 'ab8c27d5-cb93-4792-ac04-8ab35f554af2', '038ff443-dee4-452c-be16-e3704d053605', '898d9e21-4f5e-4251-bb50-f1aea0fb99f5'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:46 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:41:46 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:47 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.686s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:47 devstack cinder-volume[86621]: DEBUG cinder.manager [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Deleted volume successfully. Jul 03 17:41:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [req-cbb700df-871a-454d-9f6f-93853451172e req-e158e81d-a530-400f-9b45-dd5b4a1eca92 tempest-TestShelveInstance-990379062 None] Lock "cinder-3d6adc7d-5716-4ab0-b0a7-ccd4fd8419b9-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:47 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.704s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:41:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Deleted volume successfully. Jul 03 17:41:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-d0b92604-b3ad-4139-8236-ab633cb9ad57 tempest-VolumeDependencyTests-1696366856 None] Lock "cinder-df2dd6de-e7b8-4de1-8640-8966a7923e4e-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Flow 'volume_create_manager' (29764543-8768-4b32-9210-d22772e9e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2197ba03-0aa7-43f5-93f8-53c3539c8b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2197ba03-0aa7-43f5-93f8-53c3539c8b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9999ee75-233c-4b45-8a1d-f59cd1cc6b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809817615ae140bd851ceb5d45373fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:41:53Z,use_quota=True,user_id='cc9e547ae5204917a7c722486df73349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6059dd-8043-4bcc-96fe-4097088f3e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6059dd-8043-4bcc-96fe-4097088f3e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fc0834-43cb-4a4c-98c5-3334ef1152ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:52 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fc0834-43cb-4a4c-98c5-3334ef1152ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9999ee75-233c-4b45-8a1d-f59cd1cc6b5f', 'volume_name': 'volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f', 'volume_size': 1, 'image_id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87afc62b-f7b1-45b8-8a82-14a567cf082d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdeba88493d204a93026db7819c69125', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809817615ae140bd851ceb5d45373fc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9a264996fc1ef790b039be274f6dfd973b8118a693ab0b10beaed29e5490fd624ba1a861d38c48cf7099f7653d10969827ad9fdf15ce64702775b5814204909', 'id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'created_at': datetime.datetime(2026, 7, 3, 15, 41, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 41, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87afc62b-f7b1-45b8-8a82-14a567cf082d/file', 'properties': {}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb82ebdd-c5fd-4766-b662-f8d912afc7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb82ebdd-c5fd-4766-b662-f8d912afc7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6bb97a-f0af-456a-a5c4-9f273aad0464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:41:53 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Volume 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f', 'volume_size': 1, 'image_id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87afc62b-f7b1-45b8-8a82-14a567cf082d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdeba88493d204a93026db7819c69125', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809817615ae140bd851ceb5d45373fc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9a264996fc1ef790b039be274f6dfd973b8118a693ab0b10beaed29e5490fd624ba1a861d38c48cf7099f7653d10969827ad9fdf15ce64702775b5814204909', 'id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'created_at': datetime.datetime(2026, 7, 3, 15, 41, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 41, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87afc62b-f7b1-45b8-8a82-14a567cf082d/file', 'properties': {}}, 'image_service': } Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Trying to clone 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f from image 87afc62b-f7b1-45b8-8a82-14a567cf082d at location (None, [{'url': 'file:///opt/stack/data/glance/images/87afc62b-f7b1-45b8-8a82-14a567cf082d', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:41:53 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Image download 0.00 MB at 0.00 MB/s Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a489cfc-5743-4794-a8a2-ffa373f8eb38]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:53 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD Jul 03 17:41:53 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:54 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:54 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD Jul 03 17:41:54 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:55 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Temporary image 87afc62b-f7b1-45b8-8a82-14a567cf082d is fetched for user cc9e547ae5204917a7c722486df73349. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef6ebc-0e06-4a18-91aa-be267621e13b]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:55 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD Jul 03 17:41:55 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:55 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:55 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD Jul 03 17:41:55 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:56 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9999ee75-233c-4b45-8a1d-f59cd1cc6b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809817615ae140bd851ceb5d45373fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:41:53Z,use_quota=True,user_id='cc9e547ae5204917a7c722486df73349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Creating volume 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:41:56 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:41:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:56 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f 1073741824 Jul 03 17:41:56 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:57 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f 1073741824" returned: 0 in 0.850s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:57 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:41:57 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:58 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 0 in 0.663s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Attempting download of 87afc62b-f7b1-45b8-8a82-14a567cf082d ((None, [{'url': 'file:///opt/stack/data/glance/images/87afc62b-f7b1-45b8-8a82-14a567cf082d', 'metadata': {}}])) to volume 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f4329-3e2e-49a6-828e-4fdf3687fac7]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:58 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew Jul 03 17:41:58 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:58 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew" returned: 0 in 0.749s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:59 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew Jul 03 17:41:59 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:41:59 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 03 17:41:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew" returned: 1 in 0.719s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:41:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87afc62b-f7b1-45b8-8a82-14a567cf082d_mjejyqew' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:41:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d88c8e-a339-4ee8-95f3-80b947210190]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:41:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:41:59 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD Jul 03 17:41:59 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:00 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:00 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD Jul 03 17:42:00 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:01 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD" returned: 1 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] 87afc62b-f7b1-45b8-8a82-14a567cf082d was raw, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:01 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:42:01 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:01 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 0 in 0.750s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87afc62b-f7b1-45b8-8a82-14a567cf082d_900wqkrjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:42:01 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 17:42:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:02 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f 1G Jul 03 17:42:02 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:02 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f 1G" returned: 0 in 0.671s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:02 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ca9ce-217f-4c09-8ed9-5e5401af1056]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:02 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:42:02 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:03 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 0 in 0.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:03 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:42:03 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:04 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 1 in 0.773s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Downloaded image 87afc62b-f7b1-45b8-8a82-14a567cf082d ((None, [{'url': 'file:///opt/stack/data/glance/images/87afc62b-f7b1-45b8-8a82-14a567cf082d', 'metadata': {}}])) to volume 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Temporary image 87afc62b-f7b1-45b8-8a82-14a567cf082d for user cc9e547ae5204917a7c722486df73349 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Marking volume 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Copying metadata from image 87afc62b-f7b1-45b8-8a82-14a567cf082d to 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Creating volume glance metadata for volume 9999ee75-233c-4b45-8a1d-f59cd1cc6b5f backed by image 87afc62b-f7b1-45b8-8a82-14a567cf082d with: {'image_id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cdeba88493d204a93026db7819c69125', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6bb97a-f0af-456a-a5c4-9f273aad0464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f', 'volume_size': 1, 'image_id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87afc62b-f7b1-45b8-8a82-14a567cf082d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdeba88493d204a93026db7819c69125', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809817615ae140bd851ceb5d45373fc4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9a264996fc1ef790b039be274f6dfd973b8118a693ab0b10beaed29e5490fd624ba1a861d38c48cf7099f7653d10969827ad9fdf15ce64702775b5814204909', 'id': '87afc62b-f7b1-45b8-8a82-14a567cf082d', 'created_at': datetime.datetime(2026, 7, 3, 15, 41, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 41, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87afc62b-f7b1-45b8-8a82-14a567cf082d/file', 'properties': {}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bf0a82-0124-472f-8147-2204fab46f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:04 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Volume volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f (9999ee75-233c-4b45-8a1d-f59cd1cc6b5f): created successfully Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bf0a82-0124-472f-8147-2204fab46f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Flow 'volume_create_manager' (29764543-8768-4b32-9210-d22772e9e670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:04 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-214127f3-be7a-473b-ac63-200ebc668c33 tempest-VolumeImageDependencyTests-1199600511 None] Created volume successfully. Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Acquiring lock "cinder-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Lock "cinder-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Acquiring lock "cinder-quobyte-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Lock "cinder-quobyte-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f96faa2-e010-461a-9b67-e8dfeeb71022]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:04 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:42:04 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:05 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 0 in 0.776s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:05 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:42:05 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:06 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 1 in 0.757s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:42:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:06 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f Jul 03 17:42:06 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:07 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" returned: 0 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Lock "cinder-quobyte-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f" released by "delete_volume" :: held 2.361s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Created reservations ['e5cb09a9-8878-48af-892d-0eacf9316b13', 'aa4ab8f6-1b90-418a-9955-49e2f0f395ba', '1454afb1-c3a3-49a1-a1a5-b67d362079fe', '1ad98819-2fcd-46a1-a468-9e5b09194fea'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:07 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:07 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:07 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.644s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Deleted volume successfully. Jul 03 17:42:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f679cf3-cb19-4f01-8b68-e3419935356a tempest-VolumeImageDependencyTests-1199600511 None] Lock "cinder-9999ee75-233c-4b45-8a1d-f59cd1cc6b5f-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Flow 'volume_create_manager' (4bf32279-52bb-476a-a817-77444acaa6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b7cc87-30f4-47a0-b910-7ac54d715263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b7cc87-30f4-47a0-b910-7ac54d715263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1e4f70-0a10-423c-b878-1abf6bf0bf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089890d20be745a59fc0f14a73577871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:11Z,use_quota=True,user_id='51b613f42aa740c5a457f21bc34e6a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b246d15d-44bd-43c7-9eb1-0c12688943de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b246d15d-44bd-43c7-9eb1-0c12688943de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c69e9a-b2fd-4278-9f25-a8ff4af791fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c69e9a-b2fd-4278-9f25-a8ff4af791fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1e4f70-0a10-423c-b878-1abf6bf0bf20', 'volume_name': 'volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fc75a6-4103-4749-a36c-fe6d10e78273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fc75a6-4103-4749-a36c-fe6d10e78273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f7c7f2-c004-4b39-b5d8-cfb9bcc5ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Volume 9a1e4f70-0a10-423c-b878-1abf6bf0bf20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20', 'volume_size': 1} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1e4f70-0a10-423c-b878-1abf6bf0bf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089890d20be745a59fc0f14a73577871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:11Z,use_quota=True,user_id='51b613f42aa740c5a457f21bc34e6a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Creating volume 9a1e4f70-0a10-423c-b878-1abf6bf0bf20 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:11 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:11 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 1073741824 Jul 03 17:42:11 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:12 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 1073741824" returned: 0 in 0.981s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:12 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 Jul 03 17:42:12 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:13 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20" returned: 0 in 0.688s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f7c7f2-c004-4b39-b5d8-cfb9bcc5ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a80492-6f48-4cab-b9fb-d40946885084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Volume volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 (9a1e4f70-0a10-423c-b878-1abf6bf0bf20): created successfully Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a80492-6f48-4cab-b9fb-d40946885084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Flow 'volume_create_manager' (4bf32279-52bb-476a-a817-77444acaa6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-21e78ef7-c1fd-4b89-85d0-0fb3fa6efa84 tempest-CinderUnicodeTest-294321244 None] Created volume successfully. Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Flow 'volume_create_manager' (12ea42d3-bcab-4f21-bb89-e40e556947ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bac2022-90c6-4c48-9b74-ba94d77a552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bac2022-90c6-4c48-9b74-ba94d77a552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-679990717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f8f44b-b74a-403b-92aa-b1b745cd1219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089890d20be745a59fc0f14a73577871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:14Z,use_quota=True,user_id='51b613f42aa740c5a457f21bc34e6a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a9500-ad56-49bf-8e56-4343f49e8b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a9500-ad56-49bf-8e56-4343f49e8b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf611fa-ef87-42b1-ab19-70f77e277cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf611fa-ef87-42b1-ab19-70f77e277cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f8f44b-b74a-403b-92aa-b1b745cd1219', 'volume_name': 'volume-25f8f44b-b74a-403b-92aa-b1b745cd1219', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07206b48-b495-4c7b-a75c-dc5edaaa5d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07206b48-b495-4c7b-a75c-dc5edaaa5d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9fa3da-d277-4598-831b-3f7761f98f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Volume 25f8f44b-b74a-403b-92aa-b1b745cd1219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f8f44b-b74a-403b-92aa-b1b745cd1219', 'volume_size': 1} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-679990717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f8f44b-b74a-403b-92aa-b1b745cd1219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089890d20be745a59fc0f14a73577871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:14Z,use_quota=True,user_id='51b613f42aa740c5a457f21bc34e6a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Creating volume 25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:14 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 1073741824 Jul 03 17:42:14 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:14 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 1073741824" returned: 0 in 0.900s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:14 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 Jul 03 17:42:14 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:15 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219" returned: 0 in 0.653s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9fa3da-d277-4598-831b-3f7761f98f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f8f44b-b74a-403b-92aa-b1b745cd1219', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb0c0f8-c509-462b-bf45-9686f95ad8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Volume volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 (25f8f44b-b74a-403b-92aa-b1b745cd1219): created successfully Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb0c0f8-c509-462b-bf45-9686f95ad8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Flow 'volume_create_manager' (12ea42d3-bcab-4f21-bb89-e40e556947ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fcbd2a45-bcde-485c-b4c9-d456c3519005 tempest-CinderUnicodeTest-294321244 None] Created volume successfully. Jul 03 17:42:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Creating offline snapshot 8dc1a718-a69b-4a48-adc9-b2aea9355b7f of volume 25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:42:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9796c18-0cf5-4f5d-a147-b873b41de214]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:16 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 Jul 03 17:42:16 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:17 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219" returned: 0 in 0.793s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:17 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f 1G Jul 03 17:42:17 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:17 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f 1G" returned: 0 in 0.843s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:17 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f Jul 03 17:42:17 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:18 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:18 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f is being set with open permissions: ugo+rw Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:18 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f Jul 03 17:42:18 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Flow 'volume_create_manager' (06c358e3-ca9a-42b0-9026-12185c3aee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a88bfcb-6e56-4db5-9535-a4b7647c68ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a88bfcb-6e56-4db5-9535-a4b7647c68ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1968832158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0338a5cb-40ba-4636-bf85-58e05f118d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b932e985838a41009dde04bb55083899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:19Z,use_quota=True,user_id='e0e5ad1ac9f74c38a57ce66c09f3ae69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2610dd-a6bb-420c-8d25-e88104ee84b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2610dd-a6bb-420c-8d25-e88104ee84b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e828b225-4798-4bfb-899b-b772e374bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e828b225-4798-4bfb-899b-b772e374bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0338a5cb-40ba-4636-bf85-58e05f118d71', 'volume_name': 'volume-0338a5cb-40ba-4636-bf85-58e05f118d71', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3bc956-5cea-4829-930a-9318dae0197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3bc956-5cea-4829-930a-9318dae0197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8731f5-f50b-4687-aa34-2bdd2eff9b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Volume 0338a5cb-40ba-4636-bf85-58e05f118d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0338a5cb-40ba-4636-bf85-58e05f118d71', 'volume_size': 1} Jul 03 17:42:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:19 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f" returned: 0 in 0.684s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:19 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info Jul 03 17:42:19 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:19 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info" returned: 0 in 0.637s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:19 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info is being set with open permissions: ugo+rw Jul 03 17:42:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:20 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info Jul 03 17:42:20 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:20 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.info" returned: 0 in 0.648s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1968832158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0338a5cb-40ba-4636-bf85-58e05f118d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b932e985838a41009dde04bb55083899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:19Z,use_quota=True,user_id='e0e5ad1ac9f74c38a57ce66c09f3ae69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Creating volume 0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:20 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:20 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 1073741824 Jul 03 17:42:20 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0ce5016a-5ebe-430f-b65f-b54ced448607 tempest-CinderUnicodeTest-294321244 None] Create snapshot completed successfully Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-8dc1a718-a69b-4a48-adc9-b2aea9355b7f-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-8dc1a718-a69b-4a48-adc9-b2aea9355b7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-quobyte-25f8f44b-b74a-403b-92aa-b1b745cd1219" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-25f8f44b-b74a-403b-92aa-b1b745cd1219" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-quobyte-8dc1a718-a69b-4a48-adc9-b2aea9355b7f" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-8dc1a718-a69b-4a48-adc9-b2aea9355b7f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Deleting offline snapshot 8dc1a718-a69b-4a48-adc9-b2aea9355b7f of volume 25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] snapshot_file for this snap is: volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a881c4c-547d-4c24-80e8-6ba5f12aee24]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:21 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 1073741824" returned: 0 in 0.998s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:21 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:42:21 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:21 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f Jul 03 17:42:21 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:22 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8731f5-f50b-4687-aa34-2bdd2eff9b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0338a5cb-40ba-4636-bf85-58e05f118d71', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5613a2-624f-4126-9498-2cde8cc000f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:22 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f" returned: 0 in 0.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f8f44b-b74a-403b-92aa-b1b745cd1219(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:42:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Volume volume-0338a5cb-40ba-4636-bf85-58e05f118d71 (0338a5cb-40ba-4636-bf85-58e05f118d71): created successfully Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5613a2-624f-4126-9498-2cde8cc000f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Flow 'volume_create_manager' (06c358e3-ca9a-42b0-9026-12185c3aee4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c696eb-6711-4c21-8ec8-2cefe15322b9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c05393e5-82dd-4836-b4d3-5a80f475b3a4 tempest-TestStampPattern-2064548671 None] Created volume successfully. Jul 03 17:42:22 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 Jul 03 17:42:22 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:23 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219" returned: 0 in 0.732s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:23 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f Jul 03 17:42:23 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:23 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f" returned: 0 in 0.700s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:23 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f Jul 03 17:42:23 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:24 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219.8dc1a718-a69b-4a48-adc9-b2aea9355b7f" returned: 0 in 0.636s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-8dc1a718-a69b-4a48-adc9-b2aea9355b7f" released by "_delete_snapshot" :: held 3.014s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-25f8f44b-b74a-403b-92aa-b1b745cd1219" released by "delete_snapshot" :: held 3.037s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:24 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Created reservations ['29ebe70c-eb77-497d-8faa-14719a2a8936', 'cde03c5f-4b09-4691-89c2-37096f9842cb', 'd1d889e0-e653-4dca-89f7-f3fa4fd69ba6', '1bb08218-dc05-4b99-8101-29bac3d887ba'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Delete snapshot completed successfully. Jul 03 17:42:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a51df378-2ec2-4448-a9e3-21a4ae811971 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-8dc1a718-a69b-4a48-adc9-b2aea9355b7f-delete_snapshot" released by "delete_snapshot" :: held 3.178s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-25f8f44b-b74a-403b-92aa-b1b745cd1219-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-25f8f44b-b74a-403b-92aa-b1b745cd1219-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-quobyte-25f8f44b-b74a-403b-92aa-b1b745cd1219" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-25f8f44b-b74a-403b-92aa-b1b745cd1219" acquired by "delete_volume" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeefd33-dae6-4645-9acd-71b7dcd3eefe]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:25 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 Jul 03 17:42:25 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:26 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:26 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219 Jul 03 17:42:26 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:27 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-25f8f44b-b74a-403b-92aa-b1b745cd1219" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-25f8f44b-b74a-403b-92aa-b1b745cd1219" released by "delete_volume" :: held 1.438s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Created reservations ['4d727a7e-42a1-43b3-93f1-9dabfb6db867', '3fddee31-9733-4fc4-9a17-913624b0caba', '06b1c097-e137-4dae-93b3-511d925423bc', '51d353a3-4c53-4193-a2ce-c2cf650b84e3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:27 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:27 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-9a1e4f70-0a10-423c-b878-1abf6bf0bf20-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:27 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Lock "cinder-9a1e4f70-0a10-423c-b878-1abf6bf0bf20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Deleted volume successfully. Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0624037-355c-4660-9475-f55b6bbbd306 tempest-CinderUnicodeTest-294321244 None] Lock "cinder-25f8f44b-b74a-403b-92aa-b1b745cd1219-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Acquiring lock "cinder-quobyte-9a1e4f70-0a10-423c-b878-1abf6bf0bf20" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-9a1e4f70-0a10-423c-b878-1abf6bf0bf20" acquired by "delete_volume" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4102f28-98d2-402e-94e8-52bb8025ce4e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:28 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 Jul 03 17:42:28 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:28 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20" returned: 0 in 0.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:28 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20 Jul 03 17:42:28 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:29 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9a1e4f70-0a10-423c-b878-1abf6bf0bf20" returned: 0 in 0.622s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Lock "cinder-quobyte-9a1e4f70-0a10-423c-b878-1abf6bf0bf20" released by "delete_volume" :: held 1.413s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Created reservations ['893bd4a4-796b-4648-8a5c-ab7f6340a6bb', 'ec4b3e9e-268f-4c87-8734-29eb31392a63', 'da7ad827-b945-45a3-bb99-5b500edff525', '08ec0ffb-8cdf-4dfa-9cd5-f94f376940a4'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:29 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:29 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:30 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.621s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:30 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Deleted volume successfully. Jul 03 17:42:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f069faab-72d2-4f09-80cc-1c7544dd6b8e tempest-CinderUnicodeTest-294321244 None] Lock "cinder-9a1e4f70-0a10-423c-b878-1abf6bf0bf20-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=77,cinder:DELETE=4,cinder:SELECT=66,cinder:INSERT=27 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=53,cinder:INSERT=19,cinder:UPDATE=74,cinder:DELETE=8 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (9a837403-1459-4011-bd06-1179738dcbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21094a38-c6bb-467b-b108-abbf40d6c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21094a38-c6bb-467b-b108-abbf40d6c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1675480604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cee5d75-b51a-43b7-bdcb-b6685fb8452e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:38Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599decd0-c512-40e7-8732-98830beedabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599decd0-c512-40e7-8732-98830beedabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db30ca25-5013-469c-b15a-33a2a7b566cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db30ca25-5013-469c-b15a-33a2a7b566cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cee5d75-b51a-43b7-bdcb-b6685fb8452e', 'volume_name': 'volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b35bcd4-3b90-4d32-938f-6e2edeabe7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b35bcd4-3b90-4d32-938f-6e2edeabe7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b3845b-86e2-463d-858e-43fe6b7715d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Volume 7cee5d75-b51a-43b7-bdcb-b6685fb8452e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e', 'volume_size': 1} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1675480604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cee5d75-b51a-43b7-bdcb-b6685fb8452e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:38Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Creating volume 7cee5d75-b51a-43b7-bdcb-b6685fb8452e {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:38 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:38 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e 1073741824 Jul 03 17:42:38 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:39 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e 1073741824" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:39 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e Jul 03 17:42:39 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:40 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e" returned: 0 in 0.634s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b3845b-86e2-463d-858e-43fe6b7715d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b14087-770d-47bc-b6e4-a05759be3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Volume volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e (7cee5d75-b51a-43b7-bdcb-b6685fb8452e): created successfully Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b14087-770d-47bc-b6e4-a05759be3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (9a837403-1459-4011-bd06-1179738dcbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1822d5e5-7863-4a53-8063-280f48a703d2 tempest-ProjectReaderTests-1773511767 None] Created volume successfully. Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-7cee5d75-b51a-43b7-bdcb-b6685fb8452e-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-7cee5d75-b51a-43b7-bdcb-b6685fb8452e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-quobyte-7cee5d75-b51a-43b7-bdcb-b6685fb8452e" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-7cee5d75-b51a-43b7-bdcb-b6685fb8452e" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3911d3-17ab-4646-bcff-beb7a6047a18]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:40 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e Jul 03 17:42:40 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:41 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e" returned: 0 in 0.753s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:41 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e Jul 03 17:42:41 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:42 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7cee5d75-b51a-43b7-bdcb-b6685fb8452e" returned: 0 in 0.639s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-7cee5d75-b51a-43b7-bdcb-b6685fb8452e" released by "delete_volume" :: held 1.437s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Created reservations ['59bbbdc5-ff08-46c1-ba42-a464d21f0296', '2eccc326-6798-4368-bf4b-ef3c40b3796c', '8aa8e0aa-b43d-4c72-8879-6d717fbe8f10', '88693315-ea61-4191-a454-26d7dfc43b20'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:42 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:42 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:43 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.642s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Deleted volume successfully. Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96f12d7b-62c5-42ba-b744-0307997e2c66 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-7cee5d75-b51a-43b7-bdcb-b6685fb8452e-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (f81247eb-fd44-47eb-bfe4-9ec6dcad0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da1486d-c2b6-4963-b8f9-931d7433adbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da1486d-c2b6-4963-b8f9-931d7433adbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944406523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94adbe5b-9c45-4c06-9321-164d69ef804a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:43Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f995c461-8c1f-4181-9e31-113b3cf537e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f995c461-8c1f-4181-9e31-113b3cf537e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f9b81f-f6e7-4d34-846d-87c51724f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f9b81f-f6e7-4d34-846d-87c51724f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94adbe5b-9c45-4c06-9321-164d69ef804a', 'volume_name': 'volume-94adbe5b-9c45-4c06-9321-164d69ef804a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d726e691-516f-46cb-b753-cce84f262805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d726e691-516f-46cb-b753-cce84f262805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3b54bf-9eeb-4d04-9612-d9dc440a6a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:43 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Volume 94adbe5b-9c45-4c06-9321-164d69ef804a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94adbe5b-9c45-4c06-9321-164d69ef804a', 'volume_size': 1} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944406523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94adbe5b-9c45-4c06-9321-164d69ef804a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:43Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Creating volume 94adbe5b-9c45-4c06-9321-164d69ef804a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:43 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:43 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a 1073741824 Jul 03 17:42:43 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:43 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:43 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:44 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:42:44 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a 1073741824" returned: 0 in 0.886s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:44 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a Jul 03 17:42:44 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:45 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a" returned: 0 in 0.665s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3b54bf-9eeb-4d04-9612-d9dc440a6a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94adbe5b-9c45-4c06-9321-164d69ef804a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c3c0be-d37c-4be2-bab6-327f46fd2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:45 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Volume volume-94adbe5b-9c45-4c06-9321-164d69ef804a (94adbe5b-9c45-4c06-9321-164d69ef804a): created successfully Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c3c0be-d37c-4be2-bab6-327f46fd2194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (f81247eb-fd44-47eb-bfe4-9ec6dcad0090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-458b2ef0-638e-4208-88f7-de8647dde777 tempest-ProjectReaderTests-1773511767 None] Created volume successfully. Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-94adbe5b-9c45-4c06-9321-164d69ef804a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Lock "cinder-94adbe5b-9c45-4c06-9321-164d69ef804a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-quobyte-94adbe5b-9c45-4c06-9321-164d69ef804a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-94adbe5b-9c45-4c06-9321-164d69ef804a" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c35452-08b0-4898-ad59-92ac917822e0]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:45 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a Jul 03 17:42:45 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:46 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a" returned: 0 in 0.722s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:46 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a Jul 03 17:42:46 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:47 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-94adbe5b-9c45-4c06-9321-164d69ef804a" returned: 0 in 0.616s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-94adbe5b-9c45-4c06-9321-164d69ef804a" released by "delete_volume" :: held 1.376s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Created reservations ['d632f8ed-9084-42ef-b5f0-5407adbbce0e', '3f624837-0997-4fe4-b946-98b5f5f1d913', '4dae2330-be4b-4a0e-90fb-cd0626426d39', 'd18c3abc-36ca-4a91-85aa-4aac0151fd37'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:47 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:47 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:47 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.633s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Deleted volume successfully. Jul 03 17:42:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ca2af39f-5692-4ce9-9ab2-d3c216ff84df tempest-ProjectReaderTests-1773511767 None] Lock "cinder-94adbe5b-9c45-4c06-9321-164d69ef804a-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (f38a81b9-5db7-4d06-bbf0-45b2690bf1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa47b2b-1736-41db-a74e-73e884c16b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa47b2b-1736-41db-a74e-73e884c16b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1226224620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6da0f3-16a3-4893-9565-0873cee6830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:48Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27af3588-fdd0-4f63-a97d-19b47b124f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27af3588-fdd0-4f63-a97d-19b47b124f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7854883-9cab-4156-a852-64c0bc1c8d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7854883-9cab-4156-a852-64c0bc1c8d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6da0f3-16a3-4893-9565-0873cee6830f', 'volume_name': 'volume-de6da0f3-16a3-4893-9565-0873cee6830f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abd4c8-6b28-4ffd-867a-bab91196c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8abd4c8-6b28-4ffd-867a-bab91196c693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dbc747-6706-45a1-be49-18005f0bbc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Volume de6da0f3-16a3-4893-9565-0873cee6830f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6da0f3-16a3-4893-9565-0873cee6830f', 'volume_size': 1} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1226224620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6da0f3-16a3-4893-9565-0873cee6830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:48Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Creating volume de6da0f3-16a3-4893-9565-0873cee6830f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:48 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:48 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f 1073741824 Jul 03 17:42:48 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:49 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f 1073741824" returned: 0 in 0.783s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:49 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f Jul 03 17:42:49 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:49 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f" returned: 0 in 0.627s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6dbc747-6706-45a1-be49-18005f0bbc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6da0f3-16a3-4893-9565-0873cee6830f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b0d1d-9ab7-442f-86f4-bcbac53d54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:49 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Volume volume-de6da0f3-16a3-4893-9565-0873cee6830f (de6da0f3-16a3-4893-9565-0873cee6830f): created successfully Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b0d1d-9ab7-442f-86f4-bcbac53d54d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (f38a81b9-5db7-4d06-bbf0-45b2690bf1cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3ed34cba-2413-4017-884e-43a28d70ac5c tempest-ProjectReaderTests-1773511767 None] Created volume successfully. Jul 03 17:42:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-de6da0f3-16a3-4893-9565-0873cee6830f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Lock "cinder-de6da0f3-16a3-4893-9565-0873cee6830f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-quobyte-de6da0f3-16a3-4893-9565-0873cee6830f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-de6da0f3-16a3-4893-9565-0873cee6830f" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:50 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dfea9e-961c-4898-83e2-1aaccbc8d6d3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:50 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f Jul 03 17:42:50 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:51 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f" returned: 0 in 0.740s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:51 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f Jul 03 17:42:51 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:51 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-de6da0f3-16a3-4893-9565-0873cee6830f" returned: 0 in 0.641s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-de6da0f3-16a3-4893-9565-0873cee6830f" released by "delete_volume" :: held 1.417s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Created reservations ['4fedbf88-0d6d-4555-b6fa-5f93c42f697a', 'af5cab55-cce7-4f21-9094-f3bf7e5b6781', '41e4a3aa-e739-44bd-8caf-d539dac8e991', '830bdd06-a071-42c6-8d73-52160d90606a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:51 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:51 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:52 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.642s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Deleted volume successfully. Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-414a43c7-2eaa-46c3-a268-d1cf10564d5c tempest-ProjectReaderTests-1773511767 None] Lock "cinder-de6da0f3-16a3-4893-9565-0873cee6830f-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (fa61df8b-9cee-4494-841f-cf7aeaf413fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35254ca9-58ab-42b3-9260-74e79665d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35254ca9-58ab-42b3-9260-74e79665d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451587922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab415b3-bf5c-44ee-8461-ec8694a8df16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:53Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d1dbf6-fbdb-4339-9b2e-76d29f145950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d1dbf6-fbdb-4339-9b2e-76d29f145950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f1b384-7bd2-4d3d-b171-2c769ce9973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f1b384-7bd2-4d3d-b171-2c769ce9973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab415b3-bf5c-44ee-8461-ec8694a8df16', 'volume_name': 'volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9050adb0-6690-4128-acaa-4874f5125df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9050adb0-6690-4128-acaa-4874f5125df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0a66ba-71aa-4713-a9ef-9cae42d901ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:53 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Volume 1ab415b3-bf5c-44ee-8461-ec8694a8df16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16', 'volume_size': 1} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451587922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab415b3-bf5c-44ee-8461-ec8694a8df16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752e5b27f034861be00aaba9f3dc451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:42:53Z,use_quota=True,user_id='a8ff9db3662b4112b570c5c4be4d2a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Creating volume 1ab415b3-bf5c-44ee-8461-ec8694a8df16 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:42:53 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:53 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 1073741824 Jul 03 17:42:53 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:53 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 1073741824" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:53 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 Jul 03 17:42:53 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:54 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0a66ba-71aa-4713-a9ef-9cae42d901ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014bc25f-f9a4-4156-a092-af8a54c1a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:42:54 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Volume volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 (1ab415b3-bf5c-44ee-8461-ec8694a8df16): created successfully Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014bc25f-f9a4-4156-a092-af8a54c1a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:42:54 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Flow 'volume_create_manager' (fa61df8b-9cee-4494-841f-cf7aeaf413fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:42:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-669eda22-4048-4ec0-8f74-4ee999070526 tempest-ProjectReaderTests-1773511767 None] Created volume successfully. Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-1ab415b3-bf5c-44ee-8461-ec8694a8df16-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-1ab415b3-bf5c-44ee-8461-ec8694a8df16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "cinder-quobyte-1ab415b3-bf5c-44ee-8461-ec8694a8df16" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-1ab415b3-bf5c-44ee-8461-ec8694a8df16" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b33da-256c-4991-9b04-68984bf78855]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:55 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 Jul 03 17:42:55 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:55 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16" returned: 0 in 0.730s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:55 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16 Jul 03 17:42:55 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:56 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ab415b3-bf5c-44ee-8461-ec8694a8df16" returned: 0 in 0.633s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-quobyte-1ab415b3-bf5c-44ee-8461-ec8694a8df16" released by "delete_volume" :: held 1.401s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Created reservations ['ec084e1e-4521-4737-a3ee-a35bb9cfaea3', 'b5cd34b6-308b-4cf7-a97d-784826ffa18e', '01f9c1e6-c549-4b7a-a2cd-d535d248d929', '38abb853-ee87-4d54-bc3c-afe0c87d89ec'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:42:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:42:56 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:42:56 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:42:57 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 03 17:42:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.639s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:42:57 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:42:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Deleted volume successfully. Jul 03 17:42:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3e00862a-9410-436e-b38a-23cd723d4601 tempest-ProjectReaderTests-1773511767 None] Lock "cinder-1ab415b3-bf5c-44ee-8461-ec8694a8df16-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[087137ff-7510-4522-b758-937f81e14795]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:00 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:43:00 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:01 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.880s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.902s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:01 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-0338a5cb-40ba-4636-bf85-58e05f118d71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf9ea25e-fa77-4553-b1b7-8037017c80c3', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:43:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-feb850d8-a619-4664-8df6-d4e9ae8dcc4b req-6a27bac5-bf52-47c8-ae69-247f4040e4eb tempest-TestStampPattern-2064548671 None] attachment_update completed successfully. Jul 03 17:43:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-3f186802-4634-4185-8e11-964fdbd77a65 req-12e8da6a-4893-43b3-aefe-6525fd6f271a tempest-TestStampPattern-2064548671 None] Terminate volume connection completed successfully. Jul 03 17:43:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-3f186802-4634-4185-8e11-964fdbd77a65 req-12e8da6a-4893-43b3-aefe-6525fd6f271a tempest-TestStampPattern-2064548671 None] Deleting attachment cf9ea25e-fa77-4553-b1b7-8037017c80c3. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:43:11 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=32,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:43:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Creating offline snapshot 4c039724-8910-49ca-809e-633f4f37b7eb of volume 0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:43:12 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00770f14-5711-4b56-89e8-c1cb7a9d8ed8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:13 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:43:13 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:13 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.896s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:13 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb 1G Jul 03 17:43:13 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:14 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb 1G" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0338a5cb-40ba-4636-bf85-58e05f118d71 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:14 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0338a5cb-40ba-4636-bf85-58e05f118d71 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb Jul 03 17:43:14 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:15 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0338a5cb-40ba-4636-bf85-58e05f118d71 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb" returned: 0 in 0.673s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:15 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb is being set with open permissions: ugo+rw Jul 03 17:43:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:15 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb Jul 03 17:43:15 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:16 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb" returned: 0 in 0.662s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:16 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info Jul 03 17:43:16 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:16 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info" returned: 0 in 0.639s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:16 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info is being set with open permissions: ugo+rw Jul 03 17:43:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:16 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info Jul 03 17:43:16 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:17 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.info" returned: 0 in 0.708s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:17 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6c2b0312-b043-41f5-aece-411b5da22c7d tempest-TestStampPattern-2064548671 None] Create snapshot completed successfully Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Flow 'volume_create_manager' (0aa6ae32-55ed-4d18-af9a-73586c7914d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8144377b-bfeb-4adc-89e2-c60f9ad43dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8144377b-bfeb-4adc-89e2-c60f9ad43dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1055845418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce1fbe6-e328-4800-943c-ce574c5fbdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8bc5b0b364a43ab5bf26434560d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:43:19Z,use_quota=True,user_id='813519b5ec774faf8607e7faa3f2c071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654625f9-496e-46a9-b975-06df65a1485b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654625f9-496e-46a9-b975-06df65a1485b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e000e9b-02c7-44ec-9d18-83c304131fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e000e9b-02c7-44ec-9d18-83c304131fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce1fbe6-e328-4800-943c-ce574c5fbdc7', 'volume_name': 'volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c421b0ba-9b56-4b39-a31a-ead07f8119fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c421b0ba-9b56-4b39-a31a-ead07f8119fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beea94c-9454-40b4-a3b0-f653126b7c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Volume 1ce1fbe6-e328-4800-943c-ce574c5fbdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7', 'volume_size': 1} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1055845418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce1fbe6-e328-4800-943c-ce574c5fbdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8bc5b0b364a43ab5bf26434560d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:43:19Z,use_quota=True,user_id='813519b5ec774faf8607e7faa3f2c071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Creating volume 1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:43:18 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:43:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:18 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 1073741824 Jul 03 17:43:18 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:19 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 1073741824" returned: 0 in 0.834s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:19 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:19 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:20 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beea94c-9454-40b4-a3b0-f653126b7c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cdccb5-b036-445e-a16f-2ee8a825de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:20 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Volume volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 (1ce1fbe6-e328-4800-943c-ce574c5fbdc7): created successfully Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cdccb5-b036-445e-a16f-2ee8a825de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Flow 'volume_create_manager' (0aa6ae32-55ed-4d18-af9a-73586c7914d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:43:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1d2185d2-b61d-4839-a1b9-77ef415bebf0 tempest-SnapshotDependencyTests-1005254905 None] Created volume successfully. Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Creating offline snapshot 4b915d55-951b-40f3-a768-a947e2defa64 of volume 1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1df523-5311-42c6-a8a2-3cc435b21af7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:20 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:20 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:21 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:21 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 1G Jul 03 17:43:21 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:22 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 1G" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:22 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 Jul 03 17:43:22 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:23 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64" returned: 0 in 0.700s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:23 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 is being set with open permissions: ugo+rw Jul 03 17:43:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:23 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 Jul 03 17:43:23 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:23 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64" returned: 0 in 0.652s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:23 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info Jul 03 17:43:23 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:24 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info" returned: 0 in 0.684s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:24 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info is being set with open permissions: ugo+rw Jul 03 17:43:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:24 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info Jul 03 17:43:24 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:25 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.info" returned: 0 in 0.662s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.324s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4283da5e-d4f9-4384-8ef9-8152b5efc6b6 tempest-SnapshotDependencyTests-1005254905 None] Create snapshot completed successfully Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Flow 'volume_create_manager' (225bb121-08de-4d98-9f94-30cbd68d18ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6233baff-28f4-4ae5-8a30-ab59f715716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6233baff-28f4-4ae5-8a30-ab59f715716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f51ec45-6e3f-4e0b-9174-64f67512686c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8bc5b0b364a43ab5bf26434560d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4b915d55-951b-40f3-a768-a947e2defa64,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:43:27Z,use_quota=True,user_id='813519b5ec774faf8607e7faa3f2c071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67169c6b-1275-4d76-923d-46869dbfcc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67169c6b-1275-4d76-923d-46869dbfcc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d2f4a-ba93-4537-86e7-42896b293cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d2f4a-ba93-4537-86e7-42896b293cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f51ec45-6e3f-4e0b-9174-64f67512686c', 'volume_name': 'volume-8f51ec45-6e3f-4e0b-9174-64f67512686c', 'volume_size': 1, 'snapshot_id': '4b915d55-951b-40f3-a768-a947e2defa64'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae57bd2c-418c-4fc1-aa2d-d98faa3b8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae57bd2c-418c-4fc1-aa2d-d98faa3b8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b6723b-f42f-44f8-949e-e50c5f060965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Volume 8f51ec45-6e3f-4e0b-9174-64f67512686c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f51ec45-6e3f-4e0b-9174-64f67512686c', 'volume_size': 1, 'snapshot_id': '4b915d55-951b-40f3-a768-a947e2defa64'} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-quobyte-4b915d55-951b-40f3-a768-a947e2defa64-8f51ec45-6e3f-4e0b-9174-64f67512686c" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-4b915d55-951b-40f3-a768-a947e2defa64-8f51ec45-6e3f-4e0b-9174-64f67512686c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Creating volume 8f51ec45-6e3f-4e0b-9174-64f67512686c from snapshot 4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-quobyte-8f51ec45-6e3f-4e0b-9174-64f67512686c" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-8f51ec45-6e3f-4e0b-9174-64f67512686c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] snapshot: 4b915d55-951b-40f3-a768-a947e2defa64, volume: 8f51ec45-6e3f-4e0b-9174-64f67512686c, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc9d2e-113a-421e-9e98-7c91f5a05358]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:26 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 Jul 03 17:43:26 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:27 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:43:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:43:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:43:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c7ed7c-3f05-4d43-a79d-78cce9993efd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:27 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:27 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Flow 'volume_create_manager' (e2dafe68-12ec-4221-b53f-2f4ac13622ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e07030-77fe-4625-9c05-1bcf6eeea8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e07030-77fe-4625-9c05-1bcf6eeea8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-121150808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6520352-a133-467f-be3b-c68743702e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b932e985838a41009dde04bb55083899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c039724-8910-49ca-809e-633f4f37b7eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:43:28Z,use_quota=True,user_id='e0e5ad1ac9f74c38a57ce66c09f3ae69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81332b4b-09a7-4059-a48a-b7b4eb36fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81332b4b-09a7-4059-a48a-b7b4eb36fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd395f4-94cf-4d74-9912-6b70eee5d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd395f4-94cf-4d74-9912-6b70eee5d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6520352-a133-467f-be3b-c68743702e2c', 'volume_name': 'volume-b6520352-a133-467f-be3b-c68743702e2c', 'volume_size': 1, 'snapshot_id': '4c039724-8910-49ca-809e-633f4f37b7eb'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b09fd6c-1329-46e0-be3e-cca7d830eaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b09fd6c-1329-46e0-be3e-cca7d830eaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be34a02-8ada-4f27-94d0-16af48206db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Volume b6520352-a133-467f-be3b-c68743702e2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6520352-a133-467f-be3b-c68743702e2c', 'volume_size': 1, 'snapshot_id': '4c039724-8910-49ca-809e-633f4f37b7eb'} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:28 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 0.807s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:43:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:28 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c Jul 03 17:43:28 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:33 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c" returned: 0 in 4.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:33 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d1f98-e10f-43dd-a6cd-422fef0d00f9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:33 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:33 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:34 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 0.893s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:43:34 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Converted 1024.00 MB image at 215.48 MB/s Jul 03 17:43:34 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c is being set with open permissions: ugo+rw Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:34 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c Jul 03 17:43:34 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:34 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c" returned: 0 in 0.665s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-8f51ec45-6e3f-4e0b-9174-64f67512686c" released by "_copy_volume_from_snapshot" :: held 7.965s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-4b915d55-951b-40f3-a768-a947e2defa64-8f51ec45-6e3f-4e0b-9174-64f67512686c" released by "_create_volume_from_snapshot" :: held 7.997s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.606s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-quobyte-4c039724-8910-49ca-809e-633f4f37b7eb-b6520352-a133-467f-be3b-c68743702e2c" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-4c039724-8910-49ca-809e-633f4f37b7eb-b6520352-a133-467f-be3b-c68743702e2c" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Creating volume b6520352-a133-467f-be3b-c68743702e2c from snapshot 4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-quobyte-b6520352-a133-467f-be3b-c68743702e2c" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-b6520352-a133-467f-be3b-c68743702e2c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] snapshot: 4c039724-8910-49ca-809e-633f4f37b7eb, volume: b6520352-a133-467f-be3b-c68743702e2c, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b6723b-f42f-44f8-949e-e50c5f060965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f51ec45-6e3f-4e0b-9174-64f67512686c', 'volume_size': 1, 'snapshot_id': '4b915d55-951b-40f3-a768-a947e2defa64'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf03319-731b-4878-8702-09e5e18e776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Volume volume-8f51ec45-6e3f-4e0b-9174-64f67512686c (8f51ec45-6e3f-4e0b-9174-64f67512686c): created successfully Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf03319-731b-4878-8702-09e5e18e776f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Flow 'volume_create_manager' (225bb121-08de-4d98-9f94-30cbd68d18ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a81bba-2d97-4d1c-a6a2-26a72caeddbe]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2f632220-3bda-47b2-b709-7cc9d274df0b tempest-SnapshotDependencyTests-1005254905 None] Created volume successfully. Jul 03 17:43:35 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb Jul 03 17:43:35 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-4b915d55-951b-40f3-a768-a947e2defa64-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-4b915d55-951b-40f3-a768-a947e2defa64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-quobyte-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-quobyte-4b915d55-951b-40f3-a768-a947e2defa64" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-4b915d55-951b-40f3-a768-a947e2defa64" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Deleting offline snapshot 4b915d55-951b-40f3-a768-a947e2defa64 of volume 1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] snapshot_file for this snap is: volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c1073d-24fe-4599-91c5-9de47b0fc644]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:35 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 Jul 03 17:43:35 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:35 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb" returned: 0 in 0.885s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0338a5cb-40ba-4636-bf85-58e05f118d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f0e0f8-320f-4e43-8abd-aec628cf80d8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:35 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:43:35 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:36 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64" returned: 0 in 0.872s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f60835-f762-4b01-ae8c-fa2c88037711]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:36 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:36 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:36 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.903s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:43:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:36 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c Jul 03 17:43:36 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:37 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 0.823s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:37 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 Jul 03 17:43:37 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:38 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64" returned: 0 in 1.351s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:38 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64 Jul 03 17:43:38 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:40 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7.4b915d55-951b-40f3-a768-a947e2defa64" returned: 0 in 1.670s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=51,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=8 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-4b915d55-951b-40f3-a768-a947e2defa64" released by "_delete_snapshot" :: held 4.928s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" released by "delete_snapshot" :: held 4.974s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Created reservations ['c0a8bc2b-898e-4e23-b2c3-35971a620a5e', '2586d21c-fc04-4917-9fc4-cedf6615b76c', '0428f1c2-42d6-4c2c-b3cc-45de6c26099c', '84a419f8-a88b-4bcf-8490-e56c265d6738'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:43:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Delete snapshot completed successfully. Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b1b8bcb-7bda-4919-bc06-e92b02f5629e tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-4b915d55-951b-40f3-a768-a947e2defa64-delete_snapshot" released by "delete_snapshot" :: held 5.321s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-1ce1fbe6-e328-4800-943c-ce574c5fbdc7-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-1ce1fbe6-e328-4800-943c-ce574c5fbdc7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-quobyte-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:41 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044e6ae-3b13-4a41-8475-a0586e1015c5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:41 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:41 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:42 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:42 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 1.247s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c" returned: 0 in 5.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7506c-1fa7-47cf-98c6-28849543e77a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:42 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7 Jul 03 17:43:42 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:42 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:43:42 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:43 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-1ce1fbe6-e328-4800-943c-ce574c5fbdc7" released by "delete_volume" :: held 2.097s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Created reservations ['4052f709-5e2f-422c-b84f-3ea5030da9cb', '4387e4b1-c932-4125-8c10-aacd32472cb4', 'b19cf194-cfd0-495b-abb1-82462c32971d', '36881a31-9aa5-42ae-86eb-2205c9396a4a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:43 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:43:43 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:43 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 1.240s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:43:43 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Converted 1024.00 MB image at 180.76 MB/s Jul 03 17:43:43 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c is being set with open permissions: ugo+rw Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:43 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c Jul 03 17:43:43 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:43 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:43:43 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:44 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.941s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:43:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Deleted volume successfully. Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-29acd614-9ee7-461f-b0ae-b6e982782994 tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-1ce1fbe6-e328-4800-943c-ce574c5fbdc7-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:44 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c" returned: 0 in 0.781s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-b6520352-a133-467f-be3b-c68743702e2c" released by "_copy_volume_from_snapshot" :: held 9.608s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-4c039724-8910-49ca-809e-633f4f37b7eb-b6520352-a133-467f-be3b-c68743702e2c" released by "_create_volume_from_snapshot" :: held 9.650s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.681s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-8f51ec45-6e3f-4e0b-9174-64f67512686c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be34a02-8ada-4f27-94d0-16af48206db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6520352-a133-467f-be3b-c68743702e2c', 'volume_size': 1, 'snapshot_id': '4c039724-8910-49ca-809e-633f4f37b7eb'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d2cd61-9b1f-416c-973f-b7dd97f91a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-8f51ec45-6e3f-4e0b-9174-64f67512686c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:44 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Volume volume-b6520352-a133-467f-be3b-c68743702e2c (b6520352-a133-467f-be3b-c68743702e2c): created successfully Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d2cd61-9b1f-416c-973f-b7dd97f91a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Flow 'volume_create_manager' (e2dafe68-12ec-4221-b53f-2f4ac13622ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:43:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-96a562ff-6fbd-4fd7-b539-a3a8e3b65bc4 tempest-TestStampPattern-2064548671 None] Created volume successfully. Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "cinder-quobyte-8f51ec45-6e3f-4e0b-9174-64f67512686c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-8f51ec45-6e3f-4e0b-9174-64f67512686c" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[74776f15-4024-4e4d-83f2-e7b43e3d2601]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:44 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:43:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:43:44 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c Jul 03 17:43:44 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:45 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c" returned: 0 in 0.805s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:45 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c Jul 03 17:43:45 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:46 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8f51ec45-6e3f-4e0b-9174-64f67512686c" returned: 0 in 0.689s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-quobyte-8f51ec45-6e3f-4e0b-9174-64f67512686c" released by "delete_volume" :: held 1.535s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Created reservations ['aff088da-b38a-47ee-9bf7-b3a7b94d19f2', '2915f13d-3998-41da-a508-7c7eed8724bf', '28c50077-6e6f-4de2-9e26-7941ab6cd537', '66f80d9c-0a53-45bf-9cc1-66c97c198d74'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:43:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:43:46 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:43:46 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:43:47 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 03 17:43:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.692s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:43:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:43:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Deleted volume successfully. Jul 03 17:43:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-921b5a7a-b01b-4348-80e2-55fd2bcb071d tempest-SnapshotDependencyTests-1005254905 None] Lock "cinder-8f51ec45-6e3f-4e0b-9174-64f67512686c-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:43:56 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=26 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:43:57 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:44:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:44:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:44:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278bbe8-eeae-4b8e-acf5-f109b4085822]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:44:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:27 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c Jul 03 17:44:27 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:28 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c" returned: 0 in 0.730s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:44:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092', 'name': 'volume-b6520352-a133-467f-be3b-c68743702e2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef4b314d-b6e4-4845-8b37-75e49c793557', 'enforce_multipath': True} {{(pid=86621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 17:44:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-5449e789-d66a-4fb2-b962-1e434202be77 req-f70e7bd8-4de8-471b-a635-0834b2c8e526 tempest-TestStampPattern-2064548671 None] attachment_update completed successfully. Jul 03 17:44:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [req-7f722a27-2736-43e0-a895-fa6f8bc374b3 req-24e606ed-2603-4bcc-9d68-ca94d8d5a1a7 tempest-TestStampPattern-2064548671 None] Terminate volume connection completed successfully. Jul 03 17:44:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [req-7f722a27-2736-43e0-a895-fa6f8bc374b3 req-24e606ed-2603-4bcc-9d68-ca94d8d5a1a7 tempest-TestStampPattern-2064548671 None] Deleting attachment ef4b314d-b6e4-4845-8b37-75e49c793557. {{(pid=86621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:44:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:43 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:44:43 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:44 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.628s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-b6520352-a133-467f-be3b-c68743702e2c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Lock "cinder-b6520352-a133-467f-be3b-c68743702e2c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-quobyte-b6520352-a133-467f-be3b-c68743702e2c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-b6520352-a133-467f-be3b-c68743702e2c" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b9bd1-b413-4925-8645-f6d273631e07]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:44:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:44 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c Jul 03 17:44:44 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:45 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c" returned: 0 in 0.730s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:45 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c Jul 03 17:44:45 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:45 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b6520352-a133-467f-be3b-c68743702e2c" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-b6520352-a133-467f-be3b-c68743702e2c" released by "delete_volume" :: held 1.393s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Created reservations ['f996c418-7b89-43f1-95f1-26fe5041f334', '80e7df1f-8562-4a17-99fc-b231a872b86a', '9dd72b7c-e942-43f7-a303-f46fac10a2e3', '2926d9c7-9c01-40f1-a5a8-ab2bdbb32c20'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:44:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:46 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:44:46 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:46 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.628s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:44:46 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Deleted volume successfully. Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ec83fc24-e7a8-41b6-a441-07f2471ad00c tempest-TestStampPattern-2064548671 None] Lock "cinder-b6520352-a133-467f-be3b-c68743702e2c-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-4c039724-8910-49ca-809e-633f4f37b7eb-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Lock "cinder-4c039724-8910-49ca-809e-633f4f37b7eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-quobyte-0338a5cb-40ba-4636-bf85-58e05f118d71" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-0338a5cb-40ba-4636-bf85-58e05f118d71" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-quobyte-4c039724-8910-49ca-809e-633f4f37b7eb" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-4c039724-8910-49ca-809e-633f4f37b7eb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Deleting offline snapshot 4c039724-8910-49ca-809e-633f4f37b7eb of volume 0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] snapshot_file for this snap is: volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca459cf-3880-4950-b76f-94f0f29f22f2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:44:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:47 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb Jul 03 17:44:47 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:47 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0338a5cb-40ba-4636-bf85-58e05f118d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:44:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fae511-25a9-4958-b284-aa94fabb0ef9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:44:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:47 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:44:47 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:48 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.731s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:48 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb Jul 03 17:44:48 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:49 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb" returned: 0 in 0.686s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:49 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb Jul 03 17:44:49 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:49 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71.4c039724-8910-49ca-809e-633f4f37b7eb" returned: 0 in 0.615s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-4c039724-8910-49ca-809e-633f4f37b7eb" released by "_delete_snapshot" :: held 2.865s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-0338a5cb-40ba-4636-bf85-58e05f118d71" released by "delete_snapshot" :: held 2.885s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Created reservations ['6939694d-090a-4d66-afac-4b08844e1be0', 'e9d34044-3fcf-483e-9f5a-9fd77dffd584', '91e1763a-860a-4a37-be29-dd2f3b8a04b7', '15b17487-29ad-4e7f-97c4-73d49fe3a76e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:44:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Delete snapshot completed successfully. Jul 03 17:44:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0b9f1e4-c9e3-4467-a7e0-85ffbdcdb2be tempest-TestStampPattern-2064548671 None] Lock "cinder-4c039724-8910-49ca-809e-633f4f37b7eb-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:44:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-0338a5cb-40ba-4636-bf85-58e05f118d71-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Lock "cinder-0338a5cb-40ba-4636-bf85-58e05f118d71-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Acquiring lock "cinder-quobyte-0338a5cb-40ba-4636-bf85-58e05f118d71" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:44:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-0338a5cb-40ba-4636-bf85-58e05f118d71" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:44:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9496b5c-1438-4042-aa41-94732a4ed38b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:44:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:57 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:44:57 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:57 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.729s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:57 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71 Jul 03 17:44:57 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:58 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-0338a5cb-40ba-4636-bf85-58e05f118d71" returned: 0 in 0.633s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Lock "cinder-quobyte-0338a5cb-40ba-4636-bf85-58e05f118d71" released by "delete_volume" :: held 1.417s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Created reservations ['f3cb5535-4cc0-4c37-ae79-62f9d08a2cea', '07262409-150c-4a44-9741-c83ad297183c', '438308ed-8185-4aa4-8020-8c5c0bc10ad5', '68a0a58a-6612-4558-b1c5-42bef408b46d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:44:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:44:58 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:44:58 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:44:59 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 03 17:44:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.611s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:44:59 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:44:59 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Deleted volume successfully. Jul 03 17:44:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-22a76cec-6080-4ac3-9b66-42b57184b80f tempest-TestStampPattern-2064548671 None] Lock "cinder-0338a5cb-40ba-4636-bf85-58e05f118d71-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (265ee746-c37c-4d70-b310-c21ead932ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac1f976-6fe2-46b7-8ead-6f479c48b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac1f976-6fe2-46b7-8ead-6f479c48b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-572064450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7328af9-8f5b-4430-b121-32caf92917a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:09Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5ea89-7c57-4c4f-882f-ab8be116a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5ea89-7c57-4c4f-882f-ab8be116a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc27c3f-bf0c-43d5-982c-300eaf0902ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc27c3f-bf0c-43d5-982c-300eaf0902ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7328af9-8f5b-4430-b121-32caf92917a6', 'volume_name': 'volume-d7328af9-8f5b-4430-b121-32caf92917a6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102f9549-2d87-4148-95ba-41cd719c9482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102f9549-2d87-4148-95ba-41cd719c9482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e5dbf4-dcea-4c19-976c-e7fbedb92e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:08 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Volume d7328af9-8f5b-4430-b121-32caf92917a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7328af9-8f5b-4430-b121-32caf92917a6', 'volume_size': 1} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-572064450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7328af9-8f5b-4430-b121-32caf92917a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:09Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Creating volume d7328af9-8f5b-4430-b121-32caf92917a6 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:08 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:08 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 1073741824 Jul 03 17:45:08 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (40cec68f-ae89-4853-bc2c-652b6de26c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d86dad-11e8-4a85-ae4e-aab37ec4e58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d86dad-11e8-4a85-ae4e-aab37ec4e58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-366141982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3b520f-ffe2-4c42-a2c9-7d6309603562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:09Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af22e7a1-3070-4c15-a282-78d70ea1074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af22e7a1-3070-4c15-a282-78d70ea1074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a239817-6afe-4df9-97d2-ab2b152ab4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a239817-6afe-4df9-97d2-ab2b152ab4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3b520f-ffe2-4c42-a2c9-7d6309603562', 'volume_name': 'volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000d38b3-5df2-49c5-ad3e-b0b11b9eb5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000d38b3-5df2-49c5-ad3e-b0b11b9eb5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e76fa2-ac0b-4891-9c09-553a3920ab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Volume 7b3b520f-ffe2-4c42-a2c9-7d6309603562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562', 'volume_size': 1} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (186b2338-1f0a-48de-8442-0ee7df43992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd717b7e-1e38-498f-bc48-028180034ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd717b7e-1e38-498f-bc48-028180034ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829795795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12855a15-1a02-4e83-82d3-24dec16de1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:10Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118782bc-7064-4fbf-9f2b-93eba5580ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118782bc-7064-4fbf-9f2b-93eba5580ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927b79ed-2fce-4609-aab8-beabfda3d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927b79ed-2fce-4609-aab8-beabfda3d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12855a15-1a02-4e83-82d3-24dec16de1c6', 'volume_name': 'volume-12855a15-1a02-4e83-82d3-24dec16de1c6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facec741-6915-4d97-9ad9-6269932be521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facec741-6915-4d97-9ad9-6269932be521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3959c236-6ab1-4fe2-867d-29ed2831cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Volume 12855a15-1a02-4e83-82d3-24dec16de1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12855a15-1a02-4e83-82d3-24dec16de1c6', 'volume_size': 1} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:09 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 1073741824" returned: 0 in 0.907s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (73658ea6-b7ec-414f-90b6-9d30bf671d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90e6b62-fa59-4995-9afb-7ffc0f9d9274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90e6b62-fa59-4995-9afb-7ffc0f9d9274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739088743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a270e7-aa96-4f23-a2ba-f72eceaa091a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:10Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f460fb-4d3a-4dee-ad86-4355104b2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f460fb-4d3a-4dee-ad86-4355104b2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09debe84-a354-4573-8e47-898a746fe8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09debe84-a354-4573-8e47-898a746fe8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a270e7-aa96-4f23-a2ba-f72eceaa091a', 'volume_name': 'volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb1746d-8745-4e73-93d8-650a8cd6dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb1746d-8745-4e73-93d8-650a8cd6dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6104d9e7-1e1b-48bd-9bb1-f90de547a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Volume c0a270e7-aa96-4f23-a2ba-f72eceaa091a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a', 'volume_size': 1} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (ef2cb02b-0e78-423f-8f54-2540004d5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6081c555-846c-440f-949d-619877e1be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6081c555-846c-440f-949d-619877e1be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d670da-b4f8-4a38-af5c-4848e0c49360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:10Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab24453c-81cb-4282-8273-798387cc5d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab24453c-81cb-4282-8273-798387cc5d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9caf525-da69-4498-ac5f-0dd2d5e93f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9caf525-da69-4498-ac5f-0dd2d5e93f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d670da-b4f8-4a38-af5c-4848e0c49360', 'volume_name': 'volume-b7d670da-b4f8-4a38-af5c-4848e0c49360', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84517044-c6f0-4784-8f77-cefc5e793640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84517044-c6f0-4784-8f77-cefc5e793640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1630c016-beb7-4eb1-93a0-ed6dad868865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Volume b7d670da-b4f8-4a38-af5c-4848e0c49360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d670da-b4f8-4a38-af5c-4848e0c49360', 'volume_size': 1} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:10 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6" returned: 0 in 0.638s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-366141982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3b520f-ffe2-4c42-a2c9-7d6309603562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:09Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Creating volume 7b3b520f-ffe2-4c42-a2c9-7d6309603562 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:10 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:10 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 1073741824 Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e5dbf4-dcea-4c19-976c-e7fbedb92e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7328af9-8f5b-4430-b121-32caf92917a6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9d8ad4-33ee-402d-99c4-82c34e13c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Volume volume-d7328af9-8f5b-4430-b121-32caf92917a6 (d7328af9-8f5b-4430-b121-32caf92917a6): created successfully Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9d8ad4-33ee-402d-99c4-82c34e13c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (265ee746-c37c-4d70-b310-c21ead932ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-75692d61-fa04-4032-a504-b6ef558c9cd0 tempest-CreateVolumesFromImageTest-1395513914 None] Created volume successfully. Jul 03 17:45:11 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 1073741824" returned: 0 in 0.776s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:11 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 Jul 03 17:45:11 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:12 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562" returned: 0 in 0.618s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829795795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12855a15-1a02-4e83-82d3-24dec16de1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:10Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Creating volume 12855a15-1a02-4e83-82d3-24dec16de1c6 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:12 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e76fa2-ac0b-4891-9c09-553a3920ab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:12 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 1073741824 Jul 03 17:45:12 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c164af9c-cf5e-4b8d-8885-3c77fefd43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:12 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Volume volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 (7b3b520f-ffe2-4c42-a2c9-7d6309603562): created successfully Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c164af9c-cf5e-4b8d-8885-3c77fefd43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (40cec68f-ae89-4853-bc2c-652b6de26c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:12 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b9a1e841-b270-434c-9480-ef0b651af0df tempest-CreateVolumesFromImageTest-1395513914 None] Created volume successfully. Jul 03 17:45:12 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 1073741824" returned: 0 in 0.782s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:12 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 Jul 03 17:45:12 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:13 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739088743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a270e7-aa96-4f23-a2ba-f72eceaa091a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:10Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Creating volume c0a270e7-aa96-4f23-a2ba-f72eceaa091a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3959c236-6ab1-4fe2-867d-29ed2831cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12855a15-1a02-4e83-82d3-24dec16de1c6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:13 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a 1073741824 Jul 03 17:45:13 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c063658b-c4e3-40a1-b6d7-988ca5153f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Volume volume-12855a15-1a02-4e83-82d3-24dec16de1c6 (12855a15-1a02-4e83-82d3-24dec16de1c6): created successfully Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c063658b-c4e3-40a1-b6d7-988ca5153f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (186b2338-1f0a-48de-8442-0ee7df43992a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1436e9d6-2ef6-48de-b671-6b2c568e4a56 tempest-CreateVolumesFromImageTest-1395513914 None] Created volume successfully. Jul 03 17:45:14 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a 1073741824" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:14 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a Jul 03 17:45:14 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:14 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.615s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d670da-b4f8-4a38-af5c-4848e0c49360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9235294a6e849f991cb3d018d0c02cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:10Z,use_quota=True,user_id='aadb066316fe4ac7af255a34946a58f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Creating volume b7d670da-b4f8-4a38-af5c-4848e0c49360 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:14 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:14 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 1073741824 Jul 03 17:45:14 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6104d9e7-1e1b-48bd-9bb1-f90de547a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68db18a-b6e9-42a1-b25c-58a9053fac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:14 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Volume volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a (c0a270e7-aa96-4f23-a2ba-f72eceaa091a): created successfully Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68db18a-b6e9-42a1-b25c-58a9053fac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (73658ea6-b7ec-414f-90b6-9d30bf671d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:14 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ab0d8be9-9f85-417d-b2aa-1447d53e3282 tempest-CreateVolumesFromImageTest-1395513914 None] Created volume successfully. Jul 03 17:45:15 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 1073741824" returned: 0 in 0.792s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:15 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 Jul 03 17:45:15 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:16 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360" returned: 0 in 0.612s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1630c016-beb7-4eb1-93a0-ed6dad868865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d670da-b4f8-4a38-af5c-4848e0c49360', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0210021-ddfd-430d-927f-20468f3715c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Volume volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 (b7d670da-b4f8-4a38-af5c-4848e0c49360): created successfully Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0210021-ddfd-430d-927f-20468f3715c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Flow 'volume_create_manager' (ef2cb02b-0e78-423f-8f54-2540004d5619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6c9c0d3b-4d75-4a46-8bc3-52f49ae26eae tempest-CreateVolumesFromImageTest-1395513914 None] Created volume successfully. Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-b7d670da-b4f8-4a38-af5c-4848e0c49360-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-b7d670da-b4f8-4a38-af5c-4848e0c49360-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-quobyte-b7d670da-b4f8-4a38-af5c-4848e0c49360" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-b7d670da-b4f8-4a38-af5c-4848e0c49360" acquired by "delete_volume" :: waited 0.012s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea388e-5950-4849-be5d-4217e73ad4e2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:16 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 Jul 03 17:45:16 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:17 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360" returned: 0 in 0.740s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:17 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360 Jul 03 17:45:17 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:18 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b7d670da-b4f8-4a38-af5c-4848e0c49360" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-b7d670da-b4f8-4a38-af5c-4848e0c49360" released by "delete_volume" :: held 1.408s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Created reservations ['cf5d59be-61d1-4e3f-b9b5-4d9e1c2252e4', '15ab2626-6dff-4946-9d60-74eb1fe7d53d', '4ae6060c-ac9f-4400-97ec-cdec33fd76ac', '01963a65-ca56-4ca0-8cc7-dd07d1df19e3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:18 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:18 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-c0a270e7-aa96-4f23-a2ba-f72eceaa091a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:18 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Deleted volume successfully. Jul 03 17:45:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-c0a270e7-aa96-4f23-a2ba-f72eceaa091a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-quobyte-c0a270e7-aa96-4f23-a2ba-f72eceaa091a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-247ef8b0-ef25-4e0f-8963-be31699e3262 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-b7d670da-b4f8-4a38-af5c-4848e0c49360-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-c0a270e7-aa96-4f23-a2ba-f72eceaa091a" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d1a92-f412-4080-9c6d-bf0ae2c01b2b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:19 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a Jul 03 17:45:19 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:19 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a" returned: 0 in 0.719s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:19 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a Jul 03 17:45:19 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:20 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c0a270e7-aa96-4f23-a2ba-f72eceaa091a" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-c0a270e7-aa96-4f23-a2ba-f72eceaa091a" released by "delete_volume" :: held 1.374s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Created reservations ['6b2450c5-c84a-4d58-bc47-6d2aa2a3bdc0', '8b1bca12-939a-44a7-85fc-2904e94a55dc', 'd4708992-5ee4-4c6b-b1c5-025e140d2e94', 'e94f436a-28a1-41b1-bf80-0b6411cb1020'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:20 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:20 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:21 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.614s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:21 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Deleted volume successfully. Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-303f39a2-796f-4571-9820-bb1f309b0b12 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-c0a270e7-aa96-4f23-a2ba-f72eceaa091a-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-12855a15-1a02-4e83-82d3-24dec16de1c6-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-12855a15-1a02-4e83-82d3-24dec16de1c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-quobyte-12855a15-1a02-4e83-82d3-24dec16de1c6" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-12855a15-1a02-4e83-82d3-24dec16de1c6" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a01c9-1999-4156-8e7c-ceba275cdf05]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:21 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 Jul 03 17:45:21 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:21 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6" returned: 0 in 0.716s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:21 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6 Jul 03 17:45:21 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:22 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-12855a15-1a02-4e83-82d3-24dec16de1c6" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-12855a15-1a02-4e83-82d3-24dec16de1c6" released by "delete_volume" :: held 1.399s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Created reservations ['0711f9c7-3e3b-4681-82b3-c5358dee6e86', '3f58d4c4-bc64-42e8-b63b-5ad0344393f8', 'fb534780-a4c1-40c4-9a18-d25b597c77b7', '1a0b0fbe-0f6b-44e2-a9aa-84bcc190efcb'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:22 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:22 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-7b3b520f-ffe2-4c42-a2c9-7d6309603562-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:23 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-7b3b520f-ffe2-4c42-a2c9-7d6309603562-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Deleted volume successfully. Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-quobyte-7b3b520f-ffe2-4c42-a2c9-7d6309603562" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a08d9784-a1ae-4998-bf7e-a531bd0dc622 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-12855a15-1a02-4e83-82d3-24dec16de1c6-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-7b3b520f-ffe2-4c42-a2c9-7d6309603562" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c25f6-7fa2-4bac-a630-da460910ba84]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:23 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 Jul 03 17:45:23 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:24 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:24 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562 Jul 03 17:45:24 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:24 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-7b3b520f-ffe2-4c42-a2c9-7d6309603562" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-7b3b520f-ffe2-4c42-a2c9-7d6309603562" released by "delete_volume" :: held 1.402s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Created reservations ['7fa441c7-2d14-4cec-b79c-914f58a3bdbe', 'e9509d2c-f368-417e-9aca-2e670eb83eeb', 'acbe9357-16cb-4082-a404-6c64613404b6', 'e9f35f9b-87de-4cc4-9780-0bacad343a73'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:24 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:24 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:25 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-d7328af9-8f5b-4430-b121-32caf92917a6-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.636s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Deleted volume successfully. Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-d7328af9-8f5b-4430-b121-32caf92917a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-88b3ed64-8b4b-48d1-b787-c3e10a8682ce tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-7b3b520f-ffe2-4c42-a2c9-7d6309603562-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "cinder-quobyte-d7328af9-8f5b-4430-b121-32caf92917a6" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-d7328af9-8f5b-4430-b121-32caf92917a6" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff3b7a-7765-459c-896b-72106d11599f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:25 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 Jul 03 17:45:25 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:26 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6" returned: 0 in 0.738s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:26 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6 Jul 03 17:45:26 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:27 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-d7328af9-8f5b-4430-b121-32caf92917a6" returned: 0 in 0.612s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-quobyte-d7328af9-8f5b-4430-b121-32caf92917a6" released by "delete_volume" :: held 1.386s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=56,cinder:UPDATE=69,cinder:INSERT=18,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Created reservations ['b842331d-1621-41b4-bf60-8c79cedef56a', '8e121745-8fbd-4bef-8a52-c30025df5d9a', '2ca7a561-bf9c-4c3d-9667-5295787008c0', 'ca8106c5-307f-4078-808c-81a6e469e86b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:27 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:27 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:27 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.618s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Deleted volume successfully. Jul 03 17:45:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1c487585-efab-4ee6-b26e-e7a2a71f2082 tempest-CreateVolumesFromImageTest-1395513914 None] Lock "cinder-d7328af9-8f5b-4430-b121-32caf92917a6-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (95013205-1c9c-4e52-bfd7-d6e8671d2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e45ea4f-4841-4a4d-ad49-9a76ccb6446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e45ea4f-4841-4a4d-ad49-9a76ccb6446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-928141040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dc447e-ae8d-46b8-8d8e-3102aaea1342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:30Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fc507c-7956-447d-8f59-2dbac88113ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fc507c-7956-447d-8f59-2dbac88113ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ddbb1f-6e4e-4662-ad80-75abfbf2329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ddbb1f-6e4e-4662-ad80-75abfbf2329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41dc447e-ae8d-46b8-8d8e-3102aaea1342', 'volume_name': 'volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7714a8df-eebb-4aec-bedb-c946d44af83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7714a8df-eebb-4aec-bedb-c946d44af83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648650a8-37bf-402f-ad77-b8440f8db4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume 41dc447e-ae8d-46b8-8d8e-3102aaea1342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342', 'volume_size': 1} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-928141040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dc447e-ae8d-46b8-8d8e-3102aaea1342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:30Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Creating volume 41dc447e-ae8d-46b8-8d8e-3102aaea1342 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:30 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:30 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 1073741824 Jul 03 17:45:30 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:31 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 1073741824" returned: 0 in 0.776s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:31 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 Jul 03 17:45:31 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:31 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648650a8-37bf-402f-ad77-b8440f8db4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957c66e-3aad-4444-acf0-4fb1ae2cd6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 (41dc447e-ae8d-46b8-8d8e-3102aaea1342): created successfully Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957c66e-3aad-4444-acf0-4fb1ae2cd6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (95013205-1c9c-4e52-bfd7-d6e8671d2995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f6279979-0040-4167-9a7e-e859025e1442 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created volume successfully. Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (aad9f9c1-1216-45fa-9d9f-57dd4f912bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de8b3a-bb0a-498f-9961-fee80822c70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de8b3a-bb0a-498f-9961-fee80822c70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1888707684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd5307d-f719-4368-8685-0c62d62b3079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:33Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30567143-0894-4bbb-ac10-1b000c606c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30567143-0894-4bbb-ac10-1b000c606c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d39180c-fdd5-40ac-a11b-a08e92762113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d39180c-fdd5-40ac-a11b-a08e92762113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd5307d-f719-4368-8685-0c62d62b3079', 'volume_name': 'volume-5cd5307d-f719-4368-8685-0c62d62b3079', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1977fabd-c1e2-43c5-bce5-08ea097ade20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1977fabd-c1e2-43c5-bce5-08ea097ade20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e520a26-2a09-40c2-b89e-d8f5f4c98725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:32 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume 5cd5307d-f719-4368-8685-0c62d62b3079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd5307d-f719-4368-8685-0c62d62b3079', 'volume_size': 1} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1888707684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd5307d-f719-4368-8685-0c62d62b3079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:33Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Creating volume 5cd5307d-f719-4368-8685-0c62d62b3079 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:32 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:32 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 1073741824 Jul 03 17:45:32 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (70e4d513-203c-41b2-9c39-2e53a8b59484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b706c75a-54fc-464d-b130-deb1e3691589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b706c75a-54fc-464d-b130-deb1e3691589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946288384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edb5358-4403-428b-ab8c-439ccaf12da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:33Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f2efd0-1c8d-46f8-b54b-c34af5d06ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f2efd0-1c8d-46f8-b54b-c34af5d06ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c7a934-183d-44d8-a72e-4020f580f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c7a934-183d-44d8-a72e-4020f580f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edb5358-4403-428b-ab8c-439ccaf12da6', 'volume_name': 'volume-8edb5358-4403-428b-ab8c-439ccaf12da6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ec39ed-8e50-4aef-ad7b-fba9f75d7018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ec39ed-8e50-4aef-ad7b-fba9f75d7018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305b51b9-4682-4ac4-bbfc-5263b5d74fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume 8edb5358-4403-428b-ab8c-439ccaf12da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edb5358-4403-428b-ab8c-439ccaf12da6', 'volume_size': 1} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (1c740a78-5514-4c05-84c5-b152765006d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b989065-3839-4c9c-aa80-39480321b147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b989065-3839-4c9c-aa80-39480321b147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139342731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9bda6-e5bb-4b4d-b04d-8d496a79361f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:33Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d05da30-54ad-4dd4-9cad-37e87d7b057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d05da30-54ad-4dd4-9cad-37e87d7b057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ff2c8f-b25c-42c9-b92f-1b2f8ac0b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ff2c8f-b25c-42c9-b92f-1b2f8ac0b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a9bda6-e5bb-4b4d-b04d-8d496a79361f', 'volume_name': 'volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f078a82-bc3e-4375-8083-ed847b8e6a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f078a82-bc3e-4375-8083-ed847b8e6a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9b44b6-d2ca-4c26-916b-1dcf6aee4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume a3a9bda6-e5bb-4b4d-b04d-8d496a79361f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f', 'volume_size': 1} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:33 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 1073741824" returned: 0 in 0.892s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:33 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 Jul 03 17:45:33 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (ecb70969-08aa-4b4c-8b6b-964b348a0e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c25be9-b5e6-492f-8336-692cff18b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c25be9-b5e6-492f-8336-692cff18b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448909362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212f2924-bafe-40df-bbd7-55f69f74e792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:34Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58db54f4-aa6f-4de3-8c51-c5618ea25b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58db54f4-aa6f-4de3-8c51-c5618ea25b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d41625-f2d0-4dd9-9961-778638b4d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d41625-f2d0-4dd9-9961-778638b4d497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212f2924-bafe-40df-bbd7-55f69f74e792', 'volume_name': 'volume-212f2924-bafe-40df-bbd7-55f69f74e792', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4662103-938d-4d72-a4ed-3a256f4e4ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4662103-938d-4d72-a4ed-3a256f4e4ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d980a79-c538-4208-8195-7479b476652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume 212f2924-bafe-40df-bbd7-55f69f74e792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212f2924-bafe-40df-bbd7-55f69f74e792', 'volume_size': 1} Jul 03 17:45:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (b4e16442-5a6b-444f-9e8b-25d6a6c92b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31bed39-b887-4514-92d7-07de698d4929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31bed39-b887-4514-92d7-07de698d4929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843251845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2ad4a8-560f-4822-aec2-091c367ceee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:34Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de6dd00-445b-4cf8-b174-e563e94646dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de6dd00-445b-4cf8-b174-e563e94646dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e87212-44c8-47ba-acf8-b0420f2f4d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e87212-44c8-47ba-acf8-b0420f2f4d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2ad4a8-560f-4822-aec2-091c367ceee2', 'volume_name': 'volume-8a2ad4a8-560f-4822-aec2-091c367ceee2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9806e1-ae33-4b0f-aa4a-a355cd97965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9806e1-ae33-4b0f-aa4a-a355cd97965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddb1448-a73d-4882-b181-a9ca717df780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume 8a2ad4a8-560f-4822-aec2-091c367ceee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2ad4a8-560f-4822-aec2-091c367ceee2', 'volume_size': 1} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:34 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079" returned: 0 in 0.701s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946288384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edb5358-4403-428b-ab8c-439ccaf12da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:33Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Creating volume 8edb5358-4403-428b-ab8c-439ccaf12da6 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:34 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e520a26-2a09-40c2-b89e-d8f5f4c98725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd5307d-f719-4368-8685-0c62d62b3079', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee88b0c-b5c8-45fa-b978-40cf72a1d3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:34 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 1073741824 Jul 03 17:45:34 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume volume-5cd5307d-f719-4368-8685-0c62d62b3079 (5cd5307d-f719-4368-8685-0c62d62b3079): created successfully Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee88b0c-b5c8-45fa-b978-40cf72a1d3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (aad9f9c1-1216-45fa-9d9f-57dd4f912bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b4d1955a-d531-4ce4-972b-a740e157bda7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created volume successfully. Jul 03 17:45:35 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 1073741824" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:35 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 Jul 03 17:45:35 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:35 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.360s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139342731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9bda6-e5bb-4b4d-b04d-8d496a79361f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:33Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Creating volume a3a9bda6-e5bb-4b4d-b04d-8d496a79361f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:35 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305b51b9-4682-4ac4-bbfc-5263b5d74fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edb5358-4403-428b-ab8c-439ccaf12da6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:35 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f 1073741824 Jul 03 17:45:35 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e962cddf-319a-412d-a756-049ab1e788d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume volume-8edb5358-4403-428b-ab8c-439ccaf12da6 (8edb5358-4403-428b-ab8c-439ccaf12da6): created successfully Jul 03 17:45:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e962cddf-319a-412d-a756-049ab1e788d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (70e4d513-203c-41b2-9c39-2e53a8b59484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-731848d6-716d-47e3-b892-439ff6d061db tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created volume successfully. Jul 03 17:45:36 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f 1073741824" returned: 0 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:36 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f Jul 03 17:45:36 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:37 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f" returned: 0 in 0.634s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448909362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212f2924-bafe-40df-bbd7-55f69f74e792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:34Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Creating volume 212f2924-bafe-40df-bbd7-55f69f74e792 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:37 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9b44b6-d2ca-4c26-916b-1dcf6aee4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:37 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 1073741824 Jul 03 17:45:37 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e050170c-5a8c-4a15-8099-ce16e60d95f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:37 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f (a3a9bda6-e5bb-4b4d-b04d-8d496a79361f): created successfully Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e050170c-5a8c-4a15-8099-ce16e60d95f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (1c740a78-5514-4c05-84c5-b152765006d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4b5496e3-b44b-487e-a354-260e67262043 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created volume successfully. Jul 03 17:45:38 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 1073741824" returned: 0 in 0.783s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:38 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 Jul 03 17:45:38 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:38 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792" returned: 0 in 0.621s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.616s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843251845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2ad4a8-560f-4822-aec2-091c367ceee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2ecb2dcb77459ca7d98c4c233fe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:45:34Z,use_quota=True,user_id='f6d1bab8a3104684a61f1042ba4b0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Creating volume 8a2ad4a8-560f-4822-aec2-091c367ceee2 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:45:38 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:38 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 1073741824 Jul 03 17:45:38 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d980a79-c538-4208-8195-7479b476652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212f2924-bafe-40df-bbd7-55f69f74e792', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cac979-852e-4579-a0cd-08604fb49d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume volume-212f2924-bafe-40df-bbd7-55f69f74e792 (212f2924-bafe-40df-bbd7-55f69f74e792): created successfully Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cac979-852e-4579-a0cd-08604fb49d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (ecb70969-08aa-4b4c-8b6b-964b348a0e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a4e72fe6-75a7-469a-a959-a4b1577aef6d tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created volume successfully. Jul 03 17:45:39 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 1073741824" returned: 0 in 0.775s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:39 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 Jul 03 17:45:39 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:40 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddb1448-a73d-4882-b181-a9ca717df780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2ad4a8-560f-4822-aec2-091c367ceee2', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e25af37-8434-4411-80b3-32ff839376d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:45:40 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Volume volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 (8a2ad4a8-560f-4822-aec2-091c367ceee2): created successfully Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e25af37-8434-4411-80b3-32ff839376d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Flow 'volume_create_manager' (b4e16442-5a6b-444f-9e8b-25d6a6c92b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:45:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-365df038-e398-47ab-a06f-7c9e4d336f20 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created volume successfully. Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-8a2ad4a8-560f-4822-aec2-091c367ceee2-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-8a2ad4a8-560f-4822-aec2-091c367ceee2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-quobyte-8a2ad4a8-560f-4822-aec2-091c367ceee2" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-8a2ad4a8-560f-4822-aec2-091c367ceee2" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca529c9-fb30-4b4f-8499-8a69eb4e6a4d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:40 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 Jul 03 17:45:40 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:41 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2" returned: 0 in 0.716s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:41 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2 Jul 03 17:45:41 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:42 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8a2ad4a8-560f-4822-aec2-091c367ceee2" returned: 0 in 0.624s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-8a2ad4a8-560f-4822-aec2-091c367ceee2" released by "delete_volume" :: held 1.377s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created reservations ['5b2951ae-9446-435d-b467-f3922e8ac16b', '235cab7b-96a6-4b0c-8cb4-3268df0204b7', '036113af-5e32-4d73-a9be-76e513a68321', '4489f8fc-b039-46ee-a6d5-1f425ae1f460'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:42 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:42 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:42 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.621s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Deleted volume successfully. Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cf9c6629-4b70-4fd4-8712-38e6a93c71f7 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-8a2ad4a8-560f-4822-aec2-091c367ceee2-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-212f2924-bafe-40df-bbd7-55f69f74e792-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-212f2924-bafe-40df-bbd7-55f69f74e792-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-quobyte-212f2924-bafe-40df-bbd7-55f69f74e792" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-212f2924-bafe-40df-bbd7-55f69f74e792" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a12fba-1b79-464d-8d7c-ef46295c1d45]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:43 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 Jul 03 17:45:43 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:43 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792" returned: 0 in 0.715s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:43 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792 Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:43 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:43 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:43 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:44 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-212f2924-bafe-40df-bbd7-55f69f74e792" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-212f2924-bafe-40df-bbd7-55f69f74e792" released by "delete_volume" :: held 1.390s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:44 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.627s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created reservations ['9791ee1f-8ad5-4874-a259-69e212d77158', 'd2521b85-3b0b-4824-bfdb-ec524960a67e', '54f40198-8af8-4903-acfb-685985cbbd18', '6923ca63-52b4-4fe4-8f3e-aac839ed6bb1'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:44 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:44 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:45 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.635s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Deleted volume successfully. Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f0cf50d6-26e7-4cd4-8000-ad771a1f184e tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-212f2924-bafe-40df-bbd7-55f69f74e792-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-quobyte-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e2fff3-82cc-4458-b384-fd70b9d8ad3a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:45 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f Jul 03 17:45:45 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:45 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f" returned: 0 in 0.721s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:46 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f Jul 03 17:45:46 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:46 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f" returned: 0 in 0.620s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f" released by "delete_volume" :: held 1.378s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created reservations ['ff7a7044-a8ea-40d6-9acf-fddf2a318ffa', '11409beb-a864-40aa-8b64-5be40aa23049', 'de84a43f-6346-4797-9a65-c6102a6f6d57', '172d53c8-ad11-4565-811d-61313f928922'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:46 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:46 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:47 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-8edb5358-4403-428b-ab8c-439ccaf12da6-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Deleted volume successfully. Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-8edb5358-4403-428b-ab8c-439ccaf12da6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b67128a-5fb5-4969-b844-b852180c4170 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-a3a9bda6-e5bb-4b4d-b04d-8d496a79361f-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-quobyte-8edb5358-4403-428b-ab8c-439ccaf12da6" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-8edb5358-4403-428b-ab8c-439ccaf12da6" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d993fe6e-e5d5-4b2b-861f-7663cc4abdf2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:47 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 Jul 03 17:45:47 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:48 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6" returned: 0 in 0.724s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:48 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6 Jul 03 17:45:48 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:48 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-8edb5358-4403-428b-ab8c-439ccaf12da6" returned: 0 in 0.628s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-8edb5358-4403-428b-ab8c-439ccaf12da6" released by "delete_volume" :: held 1.389s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created reservations ['b070c42f-b0ea-4a44-afef-07cc4b7d3c72', 'efa824b7-acb0-45e1-ac53-711a1c6406c4', 'e58aa708-af9a-4393-bbf5-7a62c84f2465', 'c7328285-c6a9-4faa-ad89-f14668a58d1a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:48 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:48 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:49 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Deleted volume successfully. Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-5cd5307d-f719-4368-8685-0c62d62b3079-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cbe2a237-1586-4149-a0bd-c7b11988ef64 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-8edb5358-4403-428b-ab8c-439ccaf12da6-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-5cd5307d-f719-4368-8685-0c62d62b3079-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-quobyte-5cd5307d-f719-4368-8685-0c62d62b3079" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-5cd5307d-f719-4368-8685-0c62d62b3079" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab42d2-b17d-4f94-b7d3-2ecc48c3b480]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:49 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 Jul 03 17:45:49 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:50 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079" returned: 0 in 0.725s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:50 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079 Jul 03 17:45:50 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:50 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5cd5307d-f719-4368-8685-0c62d62b3079" returned: 0 in 0.614s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-5cd5307d-f719-4368-8685-0c62d62b3079" released by "delete_volume" :: held 1.374s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created reservations ['aa0dea86-a1a9-4698-aee5-9b11308886ea', '05b6b3dc-60c4-4ee1-afce-e10c18a36f7c', '11e9e0e0-8228-49c1-bd9a-3daf1feaf79d', '1e1d797d-3d13-4f15-a6d5-e1a8d2c60629'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:51 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:51 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-41dc447e-ae8d-46b8-8d8e-3102aaea1342-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:51 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.630s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Deleted volume successfully. Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-41dc447e-ae8d-46b8-8d8e-3102aaea1342-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-9c019488-83d8-476a-92c6-f664a902768a tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-5cd5307d-f719-4368-8685-0c62d62b3079-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "cinder-quobyte-41dc447e-ae8d-46b8-8d8e-3102aaea1342" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-41dc447e-ae8d-46b8-8d8e-3102aaea1342" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[015d5a0c-0f5f-4c04-81d3-4362362c47f1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:45:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:51 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 Jul 03 17:45:51 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:52 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:52 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342 Jul 03 17:45:52 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:53 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-41dc447e-ae8d-46b8-8d8e-3102aaea1342" returned: 0 in 0.610s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-quobyte-41dc447e-ae8d-46b8-8d8e-3102aaea1342" released by "delete_volume" :: held 1.372s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Created reservations ['5980af1b-c5c4-48ad-a6c3-8bf127a5b1b5', 'a6990508-d46e-461a-b754-11bdae192c47', '5185a242-3833-4710-a84a-7b85e81f5d48', 'd5be3700-8ff6-4678-98d2-770133af8449'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:45:53 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:45:53 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:45:53 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.623s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:45:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Deleted volume successfully. Jul 03 17:45:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3bf96a0a-7fe1-40f6-95fa-552084c3b294 tempest-CreateVolumesFromSourceVolumeTest-838775334 None] Lock "cinder-41dc447e-ae8d-46b8-8d8e-3102aaea1342-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:03 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=80,cinder:UPDATE=127,cinder:INSERT=25,cinder:DELETE=9 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:46:03 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:INSERT=20,cinder:UPDATE=70,cinder:SELECT=41,cinder:DELETE=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (efaaede8-a41b-4bd5-b87b-09e13e835755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e4ba2a-7475-4625-9f07-d122d676a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e4ba2a-7475-4625-9f07-d122d676a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791707479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626ae0f4-9495-466a-be26-4fbc9f6b1cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:06Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c846e749-0c2b-4961-83a3-b0a5f8569ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c846e749-0c2b-4961-83a3-b0a5f8569ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be66ce8-452f-47a8-a845-0f85544689e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be66ce8-452f-47a8-a845-0f85544689e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626ae0f4-9495-466a-be26-4fbc9f6b1cb1', 'volume_name': 'volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ad38ae-e9c1-4b44-ad70-ee060837833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ad38ae-e9c1-4b44-ad70-ee060837833b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474cc8d5-9435-48e4-8568-27b65b4edf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Volume 626ae0f4-9495-466a-be26-4fbc9f6b1cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1', 'volume_size': 1} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791707479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626ae0f4-9495-466a-be26-4fbc9f6b1cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:06Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Creating volume 626ae0f4-9495-466a-be26-4fbc9f6b1cb1 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:05 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:05 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 1073741824 Jul 03 17:46:05 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (81d9ebd7-ae0c-4869-90b0-b70e338f9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e1772c-fcf5-4688-b20b-0f46eac3cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e1772c-fcf5-4688-b20b-0f46eac3cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639505803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:06Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20136db9-82e6-4881-9edd-15c0de8a4869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20136db9-82e6-4881-9edd-15c0de8a4869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c6b588-f6a0-464d-bb00-2a94fe44b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c6b588-f6a0-464d-bb00-2a94fe44b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6', 'volume_name': 'volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b04647-4cd2-4de8-b39c-12e27e0f36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b04647-4cd2-4de8-b39c-12e27e0f36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba99c6c2-9e22-4ba1-bbbd-dd101ae64534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:06 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume 5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6', 'volume_size': 1} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (02a239c2-7767-4361-9ce7-6b9c04785923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1550a179-7861-4fda-b875-b7c6a69ae425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1550a179-7861-4fda-b875-b7c6a69ae425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-638657377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1bc504-c45b-472f-bd6d-e0a61f59c622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0dd7ac-fd3b-4432-81b1-73a802782215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0dd7ac-fd3b-4432-81b1-73a802782215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1039f9-f3b5-445d-aab3-43d8b6bc5733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1039f9-f3b5-445d-aab3-43d8b6bc5733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1bc504-c45b-472f-bd6d-e0a61f59c622', 'volume_name': 'volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b2bc29-e565-4586-9867-b2dc30edd9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b2bc29-e565-4586-9867-b2dc30edd9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a69a9ee-911a-4ee6-b2d0-b44f5b61d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Volume ff1bc504-c45b-472f-bd6d-e0a61f59c622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622', 'volume_size': 1} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 1073741824" returned: 0 in 1.225s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (c42597ba-a097-4b58-a8f1-5f4cac5fd6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3545c8c0-cd43-4739-8a0e-29329f68fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3545c8c0-cd43-4739-8a0e-29329f68fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-423160384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c0665a-4fad-495b-9390-5fe5f3507048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba10c76-b08c-4296-93fe-a77b3a6a2d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba10c76-b08c-4296-93fe-a77b3a6a2d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c5b4f2-c4e5-4956-9532-ce9a420efdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c5b4f2-c4e5-4956-9532-ce9a420efdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c0665a-4fad-495b-9390-5fe5f3507048', 'volume_name': 'volume-72c0665a-4fad-495b-9390-5fe5f3507048', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bba5dec-906a-4752-a563-b4ef8d38a1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bba5dec-906a-4752-a563-b4ef8d38a1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df919000-6656-497a-8f9d-2a0316cb24d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Volume 72c0665a-4fad-495b-9390-5fe5f3507048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c0665a-4fad-495b-9390-5fe5f3507048', 'volume_size': 1} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:07 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 Jul 03 17:46:07 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (65fe0144-c4e1-41cf-8a32-89dd9ba7b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae422500-4166-4131-84ab-9a2d90c793fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae422500-4166-4131-84ab-9a2d90c793fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960403798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60655665-798b-49db-b5bd-be2f61a55135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcc364c-8c28-4df8-8183-9e458da0d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcc364c-8c28-4df8-8183-9e458da0d25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3065fd6-4880-4c25-9165-28d12371fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3065fd6-4880-4c25-9165-28d12371fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60655665-798b-49db-b5bd-be2f61a55135', 'volume_name': 'volume-60655665-798b-49db-b5bd-be2f61a55135', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc583722-8878-4a36-823c-6e6b028c284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc583722-8878-4a36-823c-6e6b028c284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f548e082-1998-4239-b675-2d8685827295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Volume 60655665-798b-49db-b5bd-be2f61a55135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60655665-798b-49db-b5bd-be2f61a55135', 'volume_size': 1} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (1fff69da-dcd8-4d22-89d7-39b4017a62a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acde1fc2-3b2e-4ffb-a529-a49d302973a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acde1fc2-3b2e-4ffb-a529-a49d302973a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-980291731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae6ebc4-0d86-4ead-88f9-62b3561ebedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089b2cf2-4d1c-46b5-8425-0bf80fa00cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089b2cf2-4d1c-46b5-8425-0bf80fa00cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52763c7d-7e07-4e96-9c96-78c1f886ddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52763c7d-7e07-4e96-9c96-78c1f886ddd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae6ebc4-0d86-4ead-88f9-62b3561ebedc', 'volume_name': 'volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a075bd-02ba-4b47-aa8c-d0950744c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a075bd-02ba-4b47-aa8c-d0950744c416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb77c6b-9b36-4995-a990-013781458c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:07 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Volume 1ae6ebc4-0d86-4ead-88f9-62b3561ebedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc', 'volume_size': 1} Jul 03 17:46:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:08 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639505803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:06Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating volume 5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:08 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474cc8d5-9435-48e4-8568-27b65b4edf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:08 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 1073741824 Jul 03 17:46:08 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f793049-2b59-4319-bb0b-5d81f52e53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:08 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Volume volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 (626ae0f4-9495-466a-be26-4fbc9f6b1cb1): created successfully Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f793049-2b59-4319-bb0b-5d81f52e53d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (efaaede8-a41b-4bd5-b87b-09e13e835755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:08 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c526fd37-2bfa-441e-ac1a-7a81a3beed80 tempest-CreateVolumesFromImageTest-730743415 None] Created volume successfully. Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Flow 'volume_create_manager' (d2ff2dbe-bb6b-4bcd-913d-9d7bb24367eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ff9dac-7e57-4c2b-8209-c37a440b20ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ff9dac-7e57-4c2b-8209-c37a440b20ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a936b961-ebce-4901-9cf3-d874a3fdc5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306647e3077b43db9ab484340e8308b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:09Z,use_quota=True,user_id='1d83b68301a34e13a7fc0bb45b958bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871c76b3-df77-4d30-ab7d-20840a999866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871c76b3-df77-4d30-ab7d-20840a999866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d8326f-23d0-44d2-aee2-a60fd2bdf04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:08 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:46:09 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 1073741824" returned: 0 in 0.999s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:09 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 Jul 03 17:46:09 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d8326f-23d0-44d2-aee2-a60fd2bdf04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a936b961-ebce-4901-9cf3-d874a3fdc5b8', 'volume_name': 'volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8', 'volume_size': 1, 'image_id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/309dd15a-5d48-46df-9e1e-f39d564730c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83c83ba7a7f37bd756dec25701762e9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '306647e3077b43db9ab484340e8308b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '783ffd05741ee3220d7258aa7e3d325a3d5c8103d6a62570d2e16f037455e3b8f71e4c966cced8570cee2ae5da9cda7efb9400c10ca49e66c453e664e1173365', 'id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'created_at': datetime.datetime(2026, 7, 3, 15, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/309dd15a-5d48-46df-9e1e-f39d564730c5/file', 'properties': {}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee699980-b121-40cf-9a98-0998d0c7f984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee699980-b121-40cf-9a98-0998d0c7f984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a3899f-4010-4825-806b-704a3addd82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Volume a936b961-ebce-4901-9cf3-d874a3fdc5b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8', 'volume_size': 1, 'image_id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/309dd15a-5d48-46df-9e1e-f39d564730c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83c83ba7a7f37bd756dec25701762e9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '306647e3077b43db9ab484340e8308b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '783ffd05741ee3220d7258aa7e3d325a3d5c8103d6a62570d2e16f037455e3b8f71e4c966cced8570cee2ae5da9cda7efb9400c10ca49e66c453e664e1173365', 'id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'created_at': datetime.datetime(2026, 7, 3, 15, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/309dd15a-5d48-46df-9e1e-f39d564730c5/file', 'properties': {}}, 'image_service': } Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Trying to clone a936b961-ebce-4901-9cf3-d874a3fdc5b8 from image 309dd15a-5d48-46df-9e1e-f39d564730c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/309dd15a-5d48-46df-9e1e-f39d564730c5', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:46:09 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Image download 0.00 MB at 0.00 MB/s Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0994b-36d9-4ddf-8ccc-5633f8b7bf4e]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:09 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD Jul 03 17:46:09 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:09 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.745s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-638657377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1bc504-c45b-472f-bd6d-e0a61f59c622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Creating volume ff1bc504-c45b-472f-bd6d-e0a61f59c622 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:09 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba99c6c2-9e22-4ba1-bbbd-dd101ae64534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:09 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 1073741824 Jul 03 17:46:09 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccc4a91-cff0-45b6-8e3b-b75a0a91033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 (5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6): created successfully Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccc4a91-cff0-45b6-8e3b-b75a0a91033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (81d9ebd7-ae0c-4869-90b0-b70e338f9488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7879cf56-f82f-410a-9a70-14a4417e3dd4 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created volume successfully. Jul 03 17:46:10 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:10 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD Jul 03 17:46:10 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Flow 'volume_create_manager' (86f50078-d047-4dcf-a967-d30b03e67719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e28077-4e6c-41b8-9a0c-d75bee4be71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e28077-4e6c-41b8-9a0c-d75bee4be71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce4aaff-ed92-409e-91d9-e59e00657513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8950dad93340a2a3e5239712ea150f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:10Z,use_quota=True,user_id='f470cb4e28584575b7a2fc9bcae192cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b3e108d-f248-469a-928f-af22a8d92699),volume_type_id=0b3e108d-f248-469a-928f-af22a8d92699)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de42d665-1b8c-4896-ae43-107cfd4ea747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de42d665-1b8c-4896-ae43-107cfd4ea747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9cb4f5-84c2-4498-b591-559ed1e7690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.image.glance [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Creating Keystone auth plugin from conf {{(pid=86621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9cb4f5-84c2-4498-b591-559ed1e7690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bce4aaff-ed92-409e-91d9-e59e00657513', 'volume_name': 'volume-bce4aaff-ed92-409e-91d9-e59e00657513', 'volume_size': 1, 'image_id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e59023ebc99d85189030648e379088', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d8950dad93340a2a3e5239712ea150f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f541e9b06ed0e8aec87f4d302001fcf33b88c2d60637cbbb02cb092df51d1abad9cad9b90f53bb30ad1c7e0558b102ea251e5cfb63b058afda59f05a237ccb6', 'id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'created_at': datetime.datetime(2026, 7, 3, 15, 46, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 46, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c26a12-f775-403b-af6d-72300ee655c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c26a12-f775-403b-af6d-72300ee655c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca5b3be-b4c6-4034-8249-9cb2394b964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Volume bce4aaff-ed92-409e-91d9-e59e00657513: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bce4aaff-ed92-409e-91d9-e59e00657513', 'volume_size': 1, 'image_id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e59023ebc99d85189030648e379088', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d8950dad93340a2a3e5239712ea150f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f541e9b06ed0e8aec87f4d302001fcf33b88c2d60637cbbb02cb092df51d1abad9cad9b90f53bb30ad1c7e0558b102ea251e5cfb63b058afda59f05a237ccb6', 'id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'created_at': datetime.datetime(2026, 7, 3, 15, 46, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 46, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Trying to clone bce4aaff-ed92-409e-91d9-e59e00657513 from image 51ae47b2-2ced-4e56-b451-1f0de3f242ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'metadata': {}}]). {{(pid=86621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 17:46:10 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Image download 0.00 MB at 0.00 MB/s Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43dd0a0-8535-4344-8351-a9c3decf5e0c]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:10 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 1073741824" returned: 0 in 1.040s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:10 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD" returned: 1 in 0.750s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:10 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Temporary image 309dd15a-5d48-46df-9e1e-f39d564730c5 is fetched for user 1d83b68301a34e13a7fc0bb45b958bd0. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:46:10 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD Jul 03 17:46:10 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:10 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 Jul 03 17:46:10 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba3121-2db5-4f99-9940-ae2376028373]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:11 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD Jul 03 17:46:11 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:11 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD" returned: 0 in 0.723s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:11 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622" returned: 0 in 0.641s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.280s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-423160384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c0665a-4fad-495b-9390-5fe5f3507048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Creating volume 72c0665a-4fad-495b-9390-5fe5f3507048 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:11 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:11 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 1073741824 Jul 03 17:46:11 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a69a9ee-911a-4ee6-b2d0-b44f5b61d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9462bd8-23de-4a99-b099-5c583a30467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Volume volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 (ff1bc504-c45b-472f-bd6d-e0a61f59c622): created successfully Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9462bd8-23de-4a99-b099-5c583a30467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:11 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD Jul 03 17:46:11 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (02a239c2-7767-4361-9ce7-6b9c04785923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-27f10753-2f07-4351-a6f1-0e8fb95a0404 tempest-CreateVolumesFromImageTest-730743415 None] Created volume successfully. Jul 03 17:46:11 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:11 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD Jul 03 17:46:11 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:12 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD" returned: 1 in 0.700s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Temporary image 51ae47b2-2ced-4e56-b451-1f0de3f242ea is fetched for user f470cb4e28584575b7a2fc9bcae192cd. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db2199c-0a5e-4142-ab63-33ba4c65a354]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:12 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD Jul 03 17:46:12 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:12 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 1073741824" returned: 0 in 0.894s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:12 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 Jul 03 17:46:12 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:12 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:13 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:13 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048" returned: 0 in 0.611s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.652s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960403798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60655665-798b-49db-b5bd-be2f61a55135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Creating volume 60655665-798b-49db-b5bd-be2f61a55135 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:13 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df919000-6656-497a-8f9d-2a0316cb24d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c0665a-4fad-495b-9390-5fe5f3507048', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:13 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 1073741824 Jul 03 17:46:13 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f906be-ba4d-4115-b468-1887120adad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Volume volume-72c0665a-4fad-495b-9390-5fe5f3507048 (72c0665a-4fad-495b-9390-5fe5f3507048): created successfully Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f906be-ba4d-4115-b468-1887120adad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (c42597ba-a097-4b58-a8f1-5f4cac5fd6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:13 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD Jul 03 17:46:13 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-31329e50-9dd5-40f7-94bc-4a68dd8e079d tempest-CreateVolumesFromImageTest-730743415 None] Created volume successfully. Jul 03 17:46:13 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:13 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 1073741824" returned: 0 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:14 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 Jul 03 17:46:14 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:14 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135" returned: 0 in 0.619s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.983s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-980291731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae6ebc4-0d86-4ead-88f9-62b3561ebedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43801496c9a45ba8e8993018f9a2b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:07Z,use_quota=True,user_id='bf50d2e925704f7d858c392b286d9411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Creating volume 1ae6ebc4-0d86-4ead-88f9-62b3561ebedc {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:14 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:14 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc 1073741824 Jul 03 17:46:14 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f548e082-1998-4239-b675-2d8685827295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60655665-798b-49db-b5bd-be2f61a55135', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1278fec-4f62-408d-9eb3-40a8b590b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:14 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Volume volume-60655665-798b-49db-b5bd-be2f61a55135 (60655665-798b-49db-b5bd-be2f61a55135): created successfully Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1278fec-4f62-408d-9eb3-40a8b590b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (65fe0144-c4e1-41cf-8a32-89dd9ba7b439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:14 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a55f8761-378f-4005-8239-4a6e6fb96639 tempest-CreateVolumesFromImageTest-730743415 None] Created volume successfully. Jul 03 17:46:15 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc 1073741824" returned: 0 in 0.796s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:15 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc Jul 03 17:46:15 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:16 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc" returned: 0 in 0.608s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.671s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating offline snapshot cebfd5b8-d54b-463f-bf28-1aa57772b561 of volume 5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb77c6b-9b36-4995-a990-013781458c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4bceed-9b40-4436-a089-d1a982e88947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad89126-4f06-47ce-af5e-96feb5da38b4]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:16 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Volume volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc (1ae6ebc4-0d86-4ead-88f9-62b3561ebedc): created successfully Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4bceed-9b40-4436-a089-d1a982e88947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Flow 'volume_create_manager' (1fff69da-dcd8-4d22-89d7-39b4017a62a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:16 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-13a844b5-7473-4aa5-bcc9-6f15cc8ca01d tempest-CreateVolumesFromImageTest-730743415 None] Created volume successfully. Jul 03 17:46:16 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 Jul 03 17:46:16 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-quobyte-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d3c13b-e513-4e1a-b6ef-139c62bd8ca6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:16 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc Jul 03 17:46:16 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:16 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:16 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 1G Jul 03 17:46:16 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:17 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc" returned: 0 in 0.728s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:17 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc Jul 03 17:46:17 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:17 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 1G" returned: 0 in 0.789s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:17 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 Jul 03 17:46:17 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:17 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc" returned: 0 in 0.634s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc" released by "delete_volume" :: held 1.401s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Created reservations ['f21bc953-591e-4a5b-a762-05f39d82d0bd', '0a72e208-a26e-4ee6-ba3d-b059ce00ed1c', '8246f9e3-64f5-4c01-89fa-fcc095f2321e', '8da12c22-b16f-444f-8d7a-10a54f8a1f00'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:17 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:17 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:18 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561" returned: 0 in 0.699s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:18 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 is being set with open permissions: ugo+rw Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:18 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 Jul 03 17:46:18 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:18 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.656s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Deleted volume successfully. Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-60655665-798b-49db-b5bd-be2f61a55135-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7fab77cb-5958-410e-b317-5358bb885e83 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-1ae6ebc4-0d86-4ead-88f9-62b3561ebedc-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-60655665-798b-49db-b5bd-be2f61a55135-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-quobyte-60655665-798b-49db-b5bd-be2f61a55135" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-60655665-798b-49db-b5bd-be2f61a55135" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2084d2ac-8f7c-4b84-9a4a-a1a3b69f2250]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:18 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 Jul 03 17:46:18 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:19 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561" returned: 0 in 0.686s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:19 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info Jul 03 17:46:19 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:19 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135" returned: 0 in 0.726s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:19 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135 Jul 03 17:46:19 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:19 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info" returned: 0 in 0.653s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:19 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info is being set with open permissions: ugo+rw Jul 03 17:46:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:19 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info Jul 03 17:46:19 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:20 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-60655665-798b-49db-b5bd-be2f61a55135" returned: 0 in 0.629s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-60655665-798b-49db-b5bd-be2f61a55135" released by "delete_volume" :: held 1.396s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Created reservations ['4595219e-7777-43f9-a9d5-12482001a45d', '7fd72214-2105-46ca-9931-34309e38f402', '5cc3d42d-5b85-4f19-9dd7-52ddaf1f4376', '48f3034a-926f-432e-b099-c0d0a7608fc6'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:20 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:20 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:20 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.info" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.860s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a936b961-ebce-4901-9cf3-d874a3fdc5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306647e3077b43db9ab484340e8308b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:09Z,use_quota=True,user_id='1d83b68301a34e13a7fc0bb45b958bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Creating volume a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:20 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:20 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 1073741824 Jul 03 17:46:20 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6229cd54-5fe7-4882-a93b-932432f36ffe tempest-CreateVolumesFromSnapshotTest-1434483607 None] Create snapshot completed successfully Jul 03 17:46:20 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.671s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Deleted volume successfully. Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-72c0665a-4fad-495b-9390-5fe5f3507048-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c845cad6-8640-4dc5-8e14-f623e00e18eb tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-60655665-798b-49db-b5bd-be2f61a55135-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-72c0665a-4fad-495b-9390-5fe5f3507048-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-quobyte-72c0665a-4fad-495b-9390-5fe5f3507048" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-72c0665a-4fad-495b-9390-5fe5f3507048" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df01672a-322a-460b-9f24-80748db19e08]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:21 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 Jul 03 17:46:21 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (043fda32-d40a-4fd4-baa8-2d48ffcefda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932a9bdb-d5e2-4629-89b6-5d7f09402998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932a9bdb-d5e2-4629-89b6-5d7f09402998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093754338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f973e66-0778-4335-9cbe-67e0fddefb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:21Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d127578-d74b-490e-a4f2-dd5cc9d8fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d127578-d74b-490e-a4f2-dd5cc9d8fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1848d76-f920-47a4-b5d0-ee78977f2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1848d76-f920-47a4-b5d0-ee78977f2102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f973e66-0778-4335-9cbe-67e0fddefb19', 'volume_name': 'volume-5f973e66-0778-4335-9cbe-67e0fddefb19', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2320ff7f-e857-4745-9d0b-7a7b4b21a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2320ff7f-e857-4745-9d0b-7a7b4b21a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168eecdc-2dfd-40a2-a829-1cdf7c89857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume 5f973e66-0778-4335-9cbe-67e0fddefb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f973e66-0778-4335-9cbe-67e0fddefb19', 'volume_size': 1} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:21 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 1073741824" returned: 0 in 0.974s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:21 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:21 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (bb1cb5ee-9eea-4e78-8dde-466d2f63cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9465a4a4-57ec-4cdf-96aa-9e982fdf9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9465a4a4-57ec-4cdf-96aa-9e982fdf9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762396099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045abf93-e344-4973-b94f-6f6bba949417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:22Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa88c1a2-3b2d-4730-9cd8-70bdc9a1ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa88c1a2-3b2d-4730-9cd8-70bdc9a1ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6317c367-daaf-4fea-9fed-3bde2f291e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6317c367-daaf-4fea-9fed-3bde2f291e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045abf93-e344-4973-b94f-6f6bba949417', 'volume_name': 'volume-045abf93-e344-4973-b94f-6f6bba949417', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc78e6c0-2042-4fc2-9d68-731d47897420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc78e6c0-2042-4fc2-9d68-731d47897420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a01f5b-33f3-4ba2-98ee-fe53e7781011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume 045abf93-e344-4973-b94f-6f6bba949417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045abf93-e344-4973-b94f-6f6bba949417', 'volume_size': 1} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:21 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048" returned: 0 in 0.915s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:21 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048 Jul 03 17:46:21 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (04279290-7358-4bd3-bf18-fbdeb54ad351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd8c688-5cfa-4186-816b-a411d5b41dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd8c688-5cfa-4186-816b-a411d5b41dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829973755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007e3c4c-353c-44b1-8e16-b0b86092779f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:22Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6743c31-6e81-447e-943c-b7f7c035325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6743c31-6e81-447e-943c-b7f7c035325e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616fbba8-786f-4376-afc5-64ee1ebd915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616fbba8-786f-4376-afc5-64ee1ebd915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007e3c4c-353c-44b1-8e16-b0b86092779f', 'volume_name': 'volume-007e3c4c-353c-44b1-8e16-b0b86092779f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bb5c01-b33f-4be7-9113-751ae17f38ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bb5c01-b33f-4be7-9113-751ae17f38ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb20a5f2-0fbd-414b-b0da-c47fbcc17bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume 007e3c4c-353c-44b1-8e16-b0b86092779f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007e3c4c-353c-44b1-8e16-b0b86092779f', 'volume_size': 1} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:22 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 0 in 0.866s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.487s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce4aaff-ed92-409e-91d9-e59e00657513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8950dad93340a2a3e5239712ea150f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:10Z,use_quota=True,user_id='f470cb4e28584575b7a2fc9bcae192cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b3e108d-f248-469a-928f-af22a8d92699),volume_type_id=0b3e108d-f248-469a-928f-af22a8d92699)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Creating volume bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:22 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 1073741824 Jul 03 17:46:22 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Attempting download of 309dd15a-5d48-46df-9e1e-f39d564730c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/309dd15a-5d48-46df-9e1e-f39d564730c5', 'metadata': {}}])) to volume a936b961-ebce-4901-9cf3-d874a3fdc5b8. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (2e889311-94b2-4dbb-8e75-2212910b3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83dd1d3-25db-4f3f-9ae2-97a7e2bfdd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83dd1d3-25db-4f3f-9ae2-97a7e2bfdd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717366845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db9a6f4-5c15-40ee-ae9f-be54a555a0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:22Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04876ce-1037-4b48-b631-2f75736d9c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04876ce-1037-4b48-b631-2f75736d9c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7b435f-981f-4ea5-a302-a110e85d58d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7b435f-981f-4ea5-a302-a110e85d58d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db9a6f4-5c15-40ee-ae9f-be54a555a0aa', 'volume_name': 'volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc543b7-3766-4a1c-8c68-44ffd17571bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc543b7-3766-4a1c-8c68-44ffd17571bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d275ec93-4391-448c-8aaa-9a1c53ec2f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume 9db9a6f4-5c15-40ee-ae9f-be54a555a0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa', 'volume_size': 1} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7ee27-ebd0-4952-b54d-2d3c0cb3fc52]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:22 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3 Jul 03 17:46:22 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:22 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-72c0665a-4fad-495b-9390-5fe5f3507048" returned: 0 in 0.834s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-72c0665a-4fad-495b-9390-5fe5f3507048" released by "delete_volume" :: held 1.807s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Created reservations ['02e72aa7-8ce0-4a32-b420-e8603ecb5364', '4b099f1f-b1d3-4807-8619-503b45d110c9', 'd42ea07b-df7b-41a9-84ce-8f2ce2e8dda9', '378a7b1a-5165-4659-98e3-4921d20ebf58'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (efaaa7cb-23d5-438a-a328-3e20b650fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e944d3-60fd-4834-85ba-47bd63e820fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e944d3-60fd-4834-85ba-47bd63e820fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487370006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:23Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4392ebd-71e3-4db4-b09c-3f5bd57d0f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4392ebd-71e3-4db4-b09c-3f5bd57d0f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aea6bf6-bb5a-4094-9952-28e798119092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aea6bf6-bb5a-4094-9952-28e798119092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06', 'volume_name': 'volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a1653e-a88c-40be-a16f-933fbfd0fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a1653e-a88c-40be-a16f-933fbfd0fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:22 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bf98a2-903b-4be8-8946-c18ec39f672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:23 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume 93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06', 'volume_size': 1} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:23 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:23 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-ff1bc504-c45b-472f-bd6d-e0a61f59c622-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-ff1bc504-c45b-472f-bd6d-e0a61f59c622-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-quobyte-ff1bc504-c45b-472f-bd6d-e0a61f59c622" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-ff1bc504-c45b-472f-bd6d-e0a61f59c622" acquired by "delete_volume" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f17cd-da60-4972-9850-03dc8e63d49c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:23 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3" returned: 0 in 0.907s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:23 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 Jul 03 17:46:23 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:23 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 1073741824" returned: 0 in 1.204s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:23 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3 Jul 03 17:46:23 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:23 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:23 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:23 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.825s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Deleted volume successfully. Jul 03 17:46:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63aa91aa-3585-49d3-a121-46066c9a9209 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-72c0665a-4fad-495b-9390-5fe5f3507048-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:24 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622" returned: 0 in 0.832s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:24 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3" returned: 1 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_309dd15a-5d48-46df-9e1e-f39d564730c5_xsl5oti3' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a489f341-7d50-4889-8f7f-c3df47c738c0]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:24 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622 Jul 03 17:46:24 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:24 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 0 in 0.701s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093754338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f973e66-0778-4335-9cbe-67e0fddefb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:21Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating volume 5f973e66-0778-4335-9cbe-67e0fddefb19 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:24 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:24 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD Jul 03 17:46:24 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:24 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 1073741824 Jul 03 17:46:24 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Attempting download of 51ae47b2-2ced-4e56-b451-1f0de3f242ea ((None, [{'url': 'file:///opt/stack/data/glance/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'metadata': {}}])) to volume bce4aaff-ed92-409e-91d9-e59e00657513. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d192fd69-c6fa-46bb-b6c9-50dfb69d0d2f]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:24 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2 Jul 03 17:46:24 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:24 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff1bc504-c45b-472f-bd6d-e0a61f59c622" returned: 0 in 0.668s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-ff1bc504-c45b-472f-bd6d-e0a61f59c622" released by "delete_volume" :: held 1.557s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:24 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Created reservations ['4a1d0ccf-d04f-4b46-98d9-6e6cb6304539', '476ba50d-d174-406f-9f43-1b31ad6b1f20', '7f08964f-aeaa-4bb9-a3ad-5baf924a66fd', '4189777e-2b3f-4291-8061-75060aa83f33'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:25 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:25 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:25 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:25 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD Jul 03 17:46:25 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:25 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2" returned: 0 in 0.828s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:25 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 1073741824" returned: 0 in 0.972s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:25 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 Jul 03 17:46:25 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:25 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2 Jul 03 17:46:25 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-626ae0f4-9495-466a-be26-4fbc9f6b1cb1-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-626ae0f4-9495-466a-be26-4fbc9f6b1cb1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "cinder-quobyte-626ae0f4-9495-466a-be26-4fbc9f6b1cb1" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-626ae0f4-9495-466a-be26-4fbc9f6b1cb1" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4681886-0da0-4131-b0e0-92793f426d4d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:25 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Deleted volume successfully. Jul 03 17:46:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e9c032a4-abe4-4626-921a-3a1f0eddc99f tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-ff1bc504-c45b-472f-bd6d-e0a61f59c622-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:25 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 Jul 03 17:46:26 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:26 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD" returned: 1 in 0.990s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] 309dd15a-5d48-46df-9e1e-f39d564730c5 was raw, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:26 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:26 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:26 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19" returned: 0 in 0.865s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.475s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762396099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045abf93-e344-4973-b94f-6f6bba949417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:22Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating volume 045abf93-e344-4973-b94f-6f6bba949417 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:26 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168eecdc-2dfd-40a2-a829-1cdf7c89857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f973e66-0778-4335-9cbe-67e0fddefb19', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:26 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 1073741824 Jul 03 17:46:26 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e9eef1-ee18-4494-82f5-91faf8738768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume volume-5f973e66-0778-4335-9cbe-67e0fddefb19 (5f973e66-0778-4335-9cbe-67e0fddefb19): created successfully Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e9eef1-ee18-4494-82f5-91faf8738768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (043fda32-d40a-4fd4-baa8-2d48ffcefda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:26 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-aa26baa0-28d6-4481-9de7-ca332cb9a16f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created volume successfully. Jul 03 17:46:26 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2" returned: 1 in 1.111s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51ae47b2-2ced-4e56-b451-1f0de3f242ea_7vou48u2' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a97ae1-5aaa-47ba-bc7d-fa8086f330ce]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:26 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD Jul 03 17:46:26 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:26 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:26 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1 Jul 03 17:46:26 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:26 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 0 in 0.822s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_309dd15a-5d48-46df-9e1e-f39d564730c5_4bkw_avldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:46:26 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 17:46:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:26 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 1G Jul 03 17:46:26 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:27 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:27 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 1073741824" returned: 0 in 0.998s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:27 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD Jul 03 17:46:27 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:27 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 Jul 03 17:46:27 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:27 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-626ae0f4-9495-466a-be26-4fbc9f6b1cb1" returned: 0 in 0.743s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-quobyte-626ae0f4-9495-466a-be26-4fbc9f6b1cb1" released by "delete_volume" :: held 1.667s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Created reservations ['6bed27f5-4215-4b59-850e-cb6f3e70100a', '1537c88f-a775-4254-9bdd-6f17bc9510a6', '64718f6d-3e13-4bb4-860a-2ab2b1214bcf', 'ef660a49-f237-43bc-8029-aa10b1383231'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:27 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:27 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:27 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 1G" returned: 0 in 0.858s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c6c554-e3d3-4550-b189-8e18ad0c2215]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:27 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:27 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:27 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD" returned: 1 in 0.780s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] 51ae47b2-2ced-4e56-b451-1f0de3f242ea was raw, converting to raw {{(pid=86621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 17:46:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:27 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:27 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:28 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417" returned: 0 in 0.767s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.938s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829973755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007e3c4c-353c-44b1-8e16-b0b86092779f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:22Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating volume 007e3c4c-353c-44b1-8e16-b0b86092779f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:28 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a01f5b-33f3-4ba2-98ee-fe53e7781011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045abf93-e344-4973-b94f-6f6bba949417', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce6634-6a81-4e4c-846d-2890faa5d226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:28 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f 1073741824 Jul 03 17:46:28 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume volume-045abf93-e344-4973-b94f-6f6bba949417 (045abf93-e344-4973-b94f-6f6bba949417): created successfully Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce6634-6a81-4e4c-846d-2890faa5d226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (bb1cb5ee-9eea-4e78-8dde-466d2f63cd87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-400f9365-4bb2-4730-acc0-263692166b1b tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created volume successfully. Jul 03 17:46:28 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.974s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:28 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Deleted volume successfully. Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b399cd8-99c3-4844-b7ad-744fd8a07a13 tempest-CreateVolumesFromImageTest-730743415 None] Lock "cinder-626ae0f4-9495-466a-be26-4fbc9f6b1cb1-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:28 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 0 in 0.963s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:28 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:28 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:29 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 0 in 1.123s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_51ae47b2-2ced-4e56-b451-1f0de3f242ea_0zq9kpwddevstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:46:29 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:29 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 1G Jul 03 17:46:29 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:29 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f 1073741824" returned: 0 in 1.144s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:29 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f Jul 03 17:46:29 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:29 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 1 in 0.969s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Downloaded image 309dd15a-5d48-46df-9e1e-f39d564730c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/309dd15a-5d48-46df-9e1e-f39d564730c5', 'metadata': {}}])) to volume a936b961-ebce-4901-9cf3-d874a3fdc5b8 successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Temporary image 309dd15a-5d48-46df-9e1e-f39d564730c5 for user 1d83b68301a34e13a7fc0bb45b958bd0 is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Marking volume a936b961-ebce-4901-9cf3-d874a3fdc5b8 as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Copying metadata from image 309dd15a-5d48-46df-9e1e-f39d564730c5 to a936b961-ebce-4901-9cf3-d874a3fdc5b8. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Creating volume glance metadata for volume a936b961-ebce-4901-9cf3-d874a3fdc5b8 backed by image 309dd15a-5d48-46df-9e1e-f39d564730c5 with: {'image_id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '83c83ba7a7f37bd756dec25701762e9b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a3899f-4010-4825-806b-704a3addd82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8', 'volume_size': 1, 'image_id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/309dd15a-5d48-46df-9e1e-f39d564730c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83c83ba7a7f37bd756dec25701762e9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '306647e3077b43db9ab484340e8308b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '783ffd05741ee3220d7258aa7e3d325a3d5c8103d6a62570d2e16f037455e3b8f71e4c966cced8570cee2ae5da9cda7efb9400c10ca49e66c453e664e1173365', 'id': '309dd15a-5d48-46df-9e1e-f39d564730c5', 'created_at': datetime.datetime(2026, 7, 3, 15, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 46, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/309dd15a-5d48-46df-9e1e-f39d564730c5/file', 'properties': {}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246e517b-92c0-40f2-81da-873808e0507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:29 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Volume volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 (a936b961-ebce-4901-9cf3-d874a3fdc5b8): created successfully Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246e517b-92c0-40f2-81da-873808e0507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Flow 'volume_create_manager' (d2ff2dbe-bb6b-4bcd-913d-9d7bb24367eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:29 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3b5e7c3f-231f-4b28-b7de-761fac5622a7 tempest-VolumeImageDependencyTests-957171797 None] Created volume successfully. Jul 03 17:46:29 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 1G" returned: 0 in 0.853s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b887d09e-add7-4542-af2e-c8ce4289c40d]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:30 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.498s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717366845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db9a6f4-5c15-40ee-ae9f-be54a555a0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:22Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating volume 9db9a6f4-5c15-40ee-ae9f-be54a555a0aa {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:30 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb20a5f2-0fbd-414b-b0da-c47fbcc17bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007e3c4c-353c-44b1-8e16-b0b86092779f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:30 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa 1073741824 Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e37d9-35ea-4eea-b3c5-28a5413b1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:30 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:30 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:30 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume volume-007e3c4c-353c-44b1-8e16-b0b86092779f (007e3c4c-353c-44b1-8e16-b0b86092779f): created successfully Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e37d9-35ea-4eea-b3c5-28a5413b1d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (04279290-7358-4bd3-bf18-fbdeb54ad351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-076bbbb6-d894-4619-9d9b-e72a357a31e9 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created volume successfully. Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Acquiring lock "cinder-a936b961-ebce-4901-9cf3-d874a3fdc5b8-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Lock "cinder-a936b961-ebce-4901-9cf3-d874a3fdc5b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Acquiring lock "cinder-quobyte-a936b961-ebce-4901-9cf3-d874a3fdc5b8" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Lock "cinder-quobyte-a936b961-ebce-4901-9cf3-d874a3fdc5b8" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf5a18-144f-48df-a21e-2d4e3872d18e]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:30 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:30 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:30 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 0 in 0.909s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:31 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:31 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:31 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa 1073741824" returned: 0 in 1.018s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:31 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa Jul 03 17:46:31 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:31 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 0 in 0.904s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:31 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:31 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (1814dc52-8680-45d5-8662-1a0aba2b14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17da1112-4eb7-4e95-a1ea-6d78f1954866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17da1112-4eb7-4e95-a1ea-6d78f1954866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1606066994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896481ea-c697-4aa5-81b9-58dc12e16a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:32Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438c4755-7922-4684-a873-09b602d44462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438c4755-7922-4684-a873-09b602d44462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13384c0-eb11-4106-8d98-eaf76d570104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13384c0-eb11-4106-8d98-eaf76d570104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896481ea-c697-4aa5-81b9-58dc12e16a63', 'volume_name': 'volume-896481ea-c697-4aa5-81b9-58dc12e16a63', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d888cc1-bc59-4db2-a1e6-bb172e815a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d888cc1-bc59-4db2-a1e6-bb172e815a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f5ad1b-4327-4ce5-8ef8-4d5afc8ceb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume 896481ea-c697-4aa5-81b9-58dc12e16a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896481ea-c697-4aa5-81b9-58dc12e16a63', 'volume_size': 1} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:31 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 1 in 0.982s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Downloaded image 51ae47b2-2ced-4e56-b451-1f0de3f242ea ((None, [{'url': 'file:///opt/stack/data/glance/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'metadata': {}}])) to volume bce4aaff-ed92-409e-91d9-e59e00657513 successfully. {{(pid=86621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Temporary image 51ae47b2-2ced-4e56-b451-1f0de3f242ea for user f470cb4e28584575b7a2fc9bcae192cd is deleted. {{(pid=86621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.volume_utils [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Marking volume bce4aaff-ed92-409e-91d9-e59e00657513 as bootable. {{(pid=86621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Copying metadata from image 51ae47b2-2ced-4e56-b451-1f0de3f242ea to bce4aaff-ed92-409e-91d9-e59e00657513. {{(pid=86621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Creating volume glance metadata for volume bce4aaff-ed92-409e-91d9-e59e00657513 backed by image 51ae47b2-2ced-4e56-b451-1f0de3f242ea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f1e59023ebc99d85189030648e379088', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 17:46:31 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa" returned: 0 in 0.799s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.912s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487370006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61074987e1d4fa8b182168470c8d023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:23Z,use_quota=True,user_id='5cb1d6acdbb4452b9e3f5a63b513417e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Creating volume 93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:31 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:31 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 1073741824 Jul 03 17:46:31 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d275ec93-4391-448c-8aaa-9a1c53ec2f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167252a4-d9be-4aba-aaf1-0ea5eaf1a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:31 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa (9db9a6f4-5c15-40ee-ae9f-be54a555a0aa): created successfully Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167252a4-d9be-4aba-aaf1-0ea5eaf1a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:31 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (2e889311-94b2-4dbb-8e75-2212910b3481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-723ee4eb-f17b-44bd-8ca7-cb795a1614fa tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created volume successfully. Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca5b3be-b4c6-4034-8249-9cb2394b964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce4aaff-ed92-409e-91d9-e59e00657513', 'volume_size': 1, 'image_id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1e59023ebc99d85189030648e379088', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d8950dad93340a2a3e5239712ea150f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f541e9b06ed0e8aec87f4d302001fcf33b88c2d60637cbbb02cb092df51d1abad9cad9b90f53bb30ad1c7e0558b102ea251e5cfb63b058afda59f05a237ccb6', 'id': '51ae47b2-2ced-4e56-b451-1f0de3f242ea', 'created_at': datetime.datetime(2026, 7, 3, 15, 46, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 15, 46, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51ae47b2-2ced-4e56-b451-1f0de3f242ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5163c7fd-d6ec-406b-965b-971c1a299a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:32 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Volume volume-bce4aaff-ed92-409e-91d9-e59e00657513 (bce4aaff-ed92-409e-91d9-e59e00657513): created successfully Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5163c7fd-d6ec-406b-965b-971c1a299a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Flow 'volume_create_manager' (86f50078-d047-4dcf-a967-d30b03e67719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:32 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-03716e40-caa4-4684-a3f2-d02e95008174 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Created volume successfully. Jul 03 17:46:32 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 1 in 0.868s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:32 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8 Jul 03 17:46:32 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:32 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 1073741824" returned: 0 in 0.811s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:32 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 Jul 03 17:46:32 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Acquiring lock "cinder-bce4aaff-ed92-409e-91d9-e59e00657513-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "cinder-bce4aaff-ed92-409e-91d9-e59e00657513-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Acquiring lock "cinder-quobyte-bce4aaff-ed92-409e-91d9-e59e00657513" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "cinder-quobyte-bce4aaff-ed92-409e-91d9-e59e00657513" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd6f7bb-8f1d-41ec-9969-1fae4beb6c6f]: (4, 'raw') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:33 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a936b961-ebce-4901-9cf3-d874a3fdc5b8" returned: 0 in 0.722s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Lock "cinder-quobyte-a936b961-ebce-4901-9cf3-d874a3fdc5b8" released by "delete_volume" :: held 2.586s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Created reservations ['9abf56fd-77ea-494e-bf0a-08ea430ca943', '47c87139-4bc4-4e4b-8b1d-52761476e6ab', '26f89a35-e138-4751-ae84-6008fc447897', '3fb5aee7-65b7-423e-a332-03bc185b2947'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:33 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:33 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:33 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:33 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:33 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06" returned: 0 in 0.701s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1606066994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896481ea-c697-4aa5-81b9-58dc12e16a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:32Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Creating volume 896481ea-c697-4aa5-81b9-58dc12e16a63 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:33 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bf98a2-903b-4be8-8946-c18ec39f672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed85d87-35e4-4fa1-b5f5-a3f71558ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:33 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 1073741824 Jul 03 17:46:33 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Volume volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 (93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06): created successfully Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed85d87-35e4-4fa1-b5f5-a3f71558ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Flow 'volume_create_manager' (efaaa7cb-23d5-438a-a328-3e20b650fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3984106d-17b3-4d84-ae46-c92ab99810ba tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created volume successfully. Jul 03 17:46:33 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 0 in 0.764s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:33 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:33 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:33 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.723s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Deleted volume successfully. Jul 03 17:46:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-63bf38ee-3c93-47b5-9d05-d54a9674a5f3 tempest-VolumeImageDependencyTests-957171797 None] Lock "cinder-a936b961-ebce-4901-9cf3-d874a3fdc5b8-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6368744-8e72-4831-af20-33ea2fa0a40f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:34 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 Jul 03 17:46:34 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:34 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 1073741824" returned: 0 in 1.012s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:34 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 Jul 03 17:46:34 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:34 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 1 in 0.919s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513' failed. Not Retrying. {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 17:46:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:34 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513 Jul 03 17:46:34 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:35 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06" returned: 0 in 0.918s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:35 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06 Jul 03 17:46:35 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:35 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63" returned: 0 in 0.738s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f5ad1b-4327-4ce5-8ef8-4d5afc8ceb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896481ea-c697-4aa5-81b9-58dc12e16a63', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd48d625-6cef-4d7b-b467-11c8aec78f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:35 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume volume-896481ea-c697-4aa5-81b9-58dc12e16a63 (896481ea-c697-4aa5-81b9-58dc12e16a63): created successfully Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd48d625-6cef-4d7b-b467-11c8aec78f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (1814dc52-8680-45d5-8662-1a0aba2b14cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-adbd1bea-616c-4a9e-b651-6025d55df93a tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created volume successfully. Jul 03 17:46:35 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-bce4aaff-ed92-409e-91d9-e59e00657513" returned: 0 in 0.759s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "cinder-quobyte-bce4aaff-ed92-409e-91d9-e59e00657513" released by "delete_volume" :: held 2.511s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Created reservations ['706d49c9-d20d-41ee-8cf3-05626df041e2', '5b956358-0050-42b0-857c-402b6ab13e35', '7cf0d3fb-6420-467b-a33d-621fd04f835e', 'ff93df4a-d236-4f9c-ad74-fee0a8132c58'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:35 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:35 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:35 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06" released by "delete_volume" :: held 1.747s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['25c75089-ef79-4732-863a-22fe3cab08bd', '25dbd159-45df-455c-a17e-825348bbd165', '3570991a-5526-42c0-8a8a-c3a250bbaab2', '4e65df7b-8ee2-4ade-bb0b-f0c6c6dd255d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:36 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:36 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:36 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (b785d0cc-f132-403c-bed8-6b29462335d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abead8e-db6d-4c06-a7ab-cc8bcb4ed2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.085s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Deleted volume successfully. Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abead8e-db6d-4c06-a7ab-cc8bcb4ed2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127208046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e141435-4b0b-4114-8b32-a1c4ad0906b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:37Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ae1fc5-2d29-49c1-9ddb-944a0bfe4329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ae1fc5-2d29-49c1-9ddb-944a0bfe4329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c45e34d-6624-4d9b-bf60-fa564a37736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c45e34d-6624-4d9b-bf60-fa564a37736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e141435-4b0b-4114-8b32-a1c4ad0906b8', 'volume_name': 'volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598f4e2b-4397-467c-9a66-f1f57ce60c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598f4e2b-4397-467c-9a66-f1f57ce60c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eaf692-446c-42bb-958b-3bf15539273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume 1e141435-4b0b-4114-8b32-a1c4ad0906b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8', 'volume_size': 1} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127208046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e141435-4b0b-4114-8b32-a1c4ad0906b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:37Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Creating volume 1e141435-4b0b-4114-8b32-a1c4ad0906b8 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:36 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-1ed17adf-646b-4989-b13e-9b88772907b2 tempest-VolumeAndVolumeTypeFromImageTest-481133250 None] Lock "cinder-bce4aaff-ed92-409e-91d9-e59e00657513-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:36 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 1073741824 Jul 03 17:46:36 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa" acquired by "delete_volume" :: waited 0.043s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b78af-7773-4f68-9db1-51e13872f9ac]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (6fb455cc-5b40-43cf-92f8-f033ff25b84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a39074-92fe-4718-97c2-23c43f2ac774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 1.148s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a39074-92fe-4718-97c2-23c43f2ac774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37377402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d41f790-f72e-4f63-a63f-8f81eb3d3d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:37Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172419d9-0f5a-4e72-874c-cd86cc44d008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172419d9-0f5a-4e72-874c-cd86cc44d008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aebb6a-ac40-425b-8321-1a9d4f45affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aebb6a-ac40-425b-8321-1a9d4f45affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d41f790-f72e-4f63-a63f-8f81eb3d3d7f', 'volume_name': 'volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f62243-916f-4ec6-acd8-d3208249814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f62243-916f-4ec6-acd8-d3208249814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5a06f2-4a26-4e90-8065-61f9291e041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume 9d41f790-f72e-4f63-a63f-8f81eb3d3d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f', 'volume_size': 1} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:37 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleted volume successfully. Jul 03 17:46:37 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa Jul 03 17:46:37 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3cbb6582-8712-4099-8ead-748b135c54f1 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-93fa9439-f4c7-42b1-8b3b-0b1afb3f1e06-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (7e30e186-e4d3-4f9b-bc27-2cbe77f27b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef7eb6b-6d6b-4392-81e4-d219ad74aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef7eb6b-6d6b-4392-81e4-d219ad74aef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249961665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de2c602-4c23-4f9e-9971-3621402e340f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:38Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d940bbf-5d25-41d8-aa87-d0da32234a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d940bbf-5d25-41d8-aa87-d0da32234a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb0d4f8-59ea-423e-acdb-63323820cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb0d4f8-59ea-423e-acdb-63323820cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de2c602-4c23-4f9e-9971-3621402e340f', 'volume_name': 'volume-4de2c602-4c23-4f9e-9971-3621402e340f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cdeba1-dce5-45c6-a46e-34c1b53cc033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cdeba1-dce5-45c6-a46e-34c1b53cc033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a11be98-5d31-46c0-a6ef-80c74a67bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:37 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume 4de2c602-4c23-4f9e-9971-3621402e340f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de2c602-4c23-4f9e-9971-3621402e340f', 'volume_size': 1} Jul 03 17:46:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (c73aa897-f476-4358-a602-25f5cb953149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476fbc12-d4b2-4385-879c-a2e600aa8122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476fbc12-d4b2-4385-879c-a2e600aa8122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839687568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907b906f-fa57-491b-99f1-5e0ca494466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:38Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2731da4-cd0e-432e-8b01-cffa625bc9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2731da4-cd0e-432e-8b01-cffa625bc9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3e34bb-f567-4461-9c3a-8f091035b18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3e34bb-f567-4461-9c3a-8f091035b18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907b906f-fa57-491b-99f1-5e0ca494466b', 'volume_name': 'volume-907b906f-fa57-491b-99f1-5e0ca494466b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e509f7-8714-418b-9cd9-c1409b799db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e509f7-8714-418b-9cd9-c1409b799db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a3b08c-2b96-4122-bf50-362cd70f8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume 907b906f-fa57-491b-99f1-5e0ca494466b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907b906f-fa57-491b-99f1-5e0ca494466b', 'volume_size': 1} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:38 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa" returned: 0 in 1.392s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:38 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 1073741824" returned: 0 in 1.740s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:38 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa Jul 03 17:46:38 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:38 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 Jul 03 17:46:38 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:38 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (2a5b2ca5-f7ad-48aa-97cf-ccfc1c6c272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8725c21-2de0-414d-9930-f84659e71577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8725c21-2de0-414d-9930-f84659e71577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1648461403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5275f49d-87ca-4d44-9433-6cc04fa3bd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:39Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2377ed6d-d261-4313-9331-87b249b30ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2377ed6d-d261-4313-9331-87b249b30ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731ade39-6627-44b0-89bf-786f1988955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731ade39-6627-44b0-89bf-786f1988955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5275f49d-87ca-4d44-9433-6cc04fa3bd09', 'volume_name': 'volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24849fd6-6da6-4f69-adbb-88ebe0cd001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24849fd6-6da6-4f69-adbb-88ebe0cd001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4965cd93-48df-4c9b-9cba-447adba06b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume 5275f49d-87ca-4d44-9433-6cc04fa3bd09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09', 'volume_size': 1} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Flow 'volume_create_manager' (2fe39ed6-cf2f-4994-a820-568a46d47698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11fdafe-bad1-4ac6-b504-66e2c633b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11fdafe-bad1-4ac6-b504-66e2c633b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa67266-ce14-4e12-a2ef-3db949c65a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29046da3fcdd45a586cd9ad7ddc5b7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:39Z,use_quota=True,user_id='55cc05c7c3684d34a65b94fcefa8bcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d98567b-0f37-4297-99bd-c46e0a7a5806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d98567b-0f37-4297-99bd-c46e0a7a5806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278c9133-bee4-4305-875c-e4d491d97bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278c9133-bee4-4305-875c-e4d491d97bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa67266-ce14-4e12-a2ef-3db949c65a46', 'volume_name': 'volume-faa67266-ce14-4e12-a2ef-3db949c65a46', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054367b1-b191-4792-876c-af7acd9b0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054367b1-b191-4792-876c-af7acd9b0d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bdccda-ae11-4070-9d57-abc31ef63b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Volume faa67266-ce14-4e12-a2ef-3db949c65a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa67266-ce14-4e12-a2ef-3db949c65a46', 'volume_size': 1} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:39 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] <== create_volume: return (2575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:39 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.052s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37377402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d41f790-f72e-4f63-a63f-8f81eb3d3d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:37Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Creating volume 9d41f790-f72e-4f63-a63f-8f81eb3d3d7f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:39 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa" released by "delete_volume" :: held 2.350s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:39 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f 1073741824 Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eaf692-446c-42bb-958b-3bf15539273f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb510c88-da53-4abf-a2bb-774853f367e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:39 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:39 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 (1e141435-4b0b-4114-8b32-a1c4ad0906b8): created successfully Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb510c88-da53-4abf-a2bb-774853f367e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (b785d0cc-f132-403c-bed8-6b29462335d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-be2afd15-d921-4ef1-86ac-8aca0b367423 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created volume successfully. Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['a917f5cc-9fa2-44c9-b6e6-0d543c619ec9', '6c7f6dad-f34a-40ae-a504-ff68f0a7fee4', '0897437b-2918-478c-853a-a685cf97a847', '47c29406-908c-4308-ac23-b35e824c5033'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:39 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:39 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-007e3c4c-353c-44b1-8e16-b0b86092779f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-007e3c4c-353c-44b1-8e16-b0b86092779f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-007e3c4c-353c-44b1-8e16-b0b86092779f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-007e3c4c-353c-44b1-8e16-b0b86092779f" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f5f863-0f46-4c8d-b281-b2851d878d46]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:40 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f Jul 03 17:46:40 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:40 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f 1073741824" returned: 0 in 1.001s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:40 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.888s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:40 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f Jul 03 17:46:40 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleted volume successfully. Jul 03 17:46:40 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b0544b75-a4a2-4da9-8f95-f8825a23993f tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-9db9a6f4-5c15-40ee-ae9f-be54a555a0aa-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:40 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f" returned: 0 in 0.922s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:40 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f Jul 03 17:46:40 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:41 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f" returned: 0 in 0.766s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.300s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249961665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de2c602-4c23-4f9e-9971-3621402e340f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:38Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Creating volume 4de2c602-4c23-4f9e-9971-3621402e340f {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:41 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5a06f2-4a26-4e90-8065-61f9291e041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d2ce6d-719f-494f-9c6a-6bf4d44d700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:41 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f 1073741824 Jul 03 17:46:41 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:41 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f (9d41f790-f72e-4f63-a63f-8f81eb3d3d7f): created successfully Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d2ce6d-719f-494f-9c6a-6bf4d44d700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (6fb455cc-5b40-43cf-92f8-f033ff25b84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1afdcc31-0cea-47eb-9a28-5671f833cbba tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created volume successfully. Jul 03 17:46:41 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-007e3c4c-353c-44b1-8e16-b0b86092779f" returned: 0 in 0.688s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-007e3c4c-353c-44b1-8e16-b0b86092779f" released by "delete_volume" :: held 1.668s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['da03cfaf-99a7-4b42-95ff-8f7f95b151c1', 'deb85324-3093-40e8-8eb1-409bc5cacd4b', '080a7804-4d38-4725-80b6-5221303619e7', 'fd0d6557-961d-476a-8703-1b8a806abef0'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:41 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:41 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-045abf93-e344-4973-b94f-6f6bba949417-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-045abf93-e344-4973-b94f-6f6bba949417-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-045abf93-e344-4973-b94f-6f6bba949417" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-045abf93-e344-4973-b94f-6f6bba949417" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[372bc9bc-ec7e-4663-ac5a-548c8be89ef2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:42 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f 1073741824" returned: 0 in 1.029s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:42 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f Jul 03 17:46:42 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:42 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 Jul 03 17:46:42 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:42 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.742s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleted volume successfully. Jul 03 17:46:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5ee55f5d-6491-4e44-884a-321430a54eb5 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-007e3c4c-353c-44b1-8e16-b0b86092779f-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:43 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f" returned: 0 in 0.718s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.517s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839687568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907b906f-fa57-491b-99f1-5e0ca494466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:38Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Creating volume 907b906f-fa57-491b-99f1-5e0ca494466b {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:43 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:43 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b 1073741824 Jul 03 17:46:43 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a11be98-5d31-46c0-a6ef-80c74a67bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de2c602-4c23-4f9e-9971-3621402e340f', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604e12e9-e4f9-4599-82de-7184ca3d6297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:43 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417" returned: 0 in 0.853s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:43 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume volume-4de2c602-4c23-4f9e-9971-3621402e340f (4de2c602-4c23-4f9e-9971-3621402e340f): created successfully Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604e12e9-e4f9-4599-82de-7184ca3d6297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (7e30e186-e4d3-4f9b-bc27-2cbe77f27b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:43 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417 Jul 03 17:46:43 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-57145507-a490-4ad1-8168-3da68b75d4e2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created volume successfully. Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:43 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:43 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:43 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-045abf93-e344-4973-b94f-6f6bba949417" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-045abf93-e344-4973-b94f-6f6bba949417" released by "delete_volume" :: held 1.605s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['00931f97-dba6-425e-a825-9c9f91ff32e1', '92c3d590-108e-49f3-86b5-94fcdc1cb80a', '2997cb2c-fa41-4b6c-a0c9-5da2ddb026ba', 'e68cfd06-bc9e-4332-8574-5ba3d9345d6b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:43 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b 1073741824" returned: 0 in 0.899s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:44 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:44 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:44 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b Jul 03 17:46:44 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-5f973e66-0778-4335-9cbe-67e0fddefb19-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-5f973e66-0778-4335-9cbe-67e0fddefb19-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-5f973e66-0778-4335-9cbe-67e0fddefb19" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-5f973e66-0778-4335-9cbe-67e0fddefb19" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51bd714-e083-431a-92f7-e6bdd9031cae]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:44 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.940s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:46:44 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.797s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleted volume successfully. Jul 03 17:46:44 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 Jul 03 17:46:44 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-000f1766-7d0a-4bdf-b653-27a070f462e7 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-045abf93-e344-4973-b94f-6f6bba949417-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:44 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.795s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1648461403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5275f49d-87ca-4d44-9433-6cc04fa3bd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc518e694b43bb98763ba66e574b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:39Z,use_quota=True,user_id='640524e7364943a39013e00d334f0e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Creating volume 5275f49d-87ca-4d44-9433-6cc04fa3bd09 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:44 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:44 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 1073741824 Jul 03 17:46:44 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a3b08c-2b96-4122-bf50-362cd70f8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907b906f-fa57-491b-99f1-5e0ca494466b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf23349-9ca6-433d-8a8b-c1775d4e6ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:44 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume volume-907b906f-fa57-491b-99f1-5e0ca494466b (907b906f-fa57-491b-99f1-5e0ca494466b): created successfully Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf23349-9ca6-433d-8a8b-c1775d4e6ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (c73aa897-f476-4358-a602-25f5cb953149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b170bdfb-e59e-4b84-b24d-50cf34fa380f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created volume successfully. Jul 03 17:46:45 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19" returned: 0 in 0.840s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:45 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19 Jul 03 17:46:45 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:45 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 1073741824" returned: 0 in 0.913s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:45 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 Jul 03 17:46:45 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:46 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5f973e66-0778-4335-9cbe-67e0fddefb19" returned: 0 in 0.733s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-5f973e66-0778-4335-9cbe-67e0fddefb19" released by "delete_volume" :: held 1.631s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['47a9ce84-dc91-4ade-8753-1adbd4b69fdf', '5813678f-68d3-43c3-ad67-6dcf9d5b78a0', '7ab1e9a1-73b1-44e7-b0de-a65eae57e73b', '28097239-5243-4a14-8c0a-0d3390d148a0'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:46 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:46 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:46 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09" returned: 0 in 0.681s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.325s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa67266-ce14-4e12-a2ef-3db949c65a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29046da3fcdd45a586cd9ad7ddc5b7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:39Z,use_quota=True,user_id='55cc05c7c3684d34a65b94fcefa8bcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Creating volume faa67266-ce14-4e12-a2ef-3db949c65a46 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:46 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:46 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 1073741824 Jul 03 17:46:46 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4965cd93-48df-4c9b-9cba-447adba06b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5645189-bf94-4108-b78e-b8ece0680c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:46 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Volume volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 (5275f49d-87ca-4d44-9433-6cc04fa3bd09): created successfully Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5645189-bf94-4108-b78e-b8ece0680c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Flow 'volume_create_manager' (2a5b2ca5-f7ad-48aa-97cf-ccfc1c6c272a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:46 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0d1a9371-779a-4803-bcec-08960645de9e tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created volume successfully. Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-cebfd5b8-d54b-463f-bf28-1aa57772b561-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-cebfd5b8-d54b-463f-bf28-1aa57772b561-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-cebfd5b8-d54b-463f-bf28-1aa57772b561" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-cebfd5b8-d54b-463f-bf28-1aa57772b561" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleting offline snapshot cebfd5b8-d54b-463f-bf28-1aa57772b561 of volume 5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] snapshot_file for this snap is: volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79904e7-5144-42f1-88bb-0648518042a6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:47 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 Jul 03 17:46:47 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:47 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.807s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleted volume successfully. Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0023a43a-2e7a-4fd7-bdf9-f3bfc8eb7b54 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-5f973e66-0778-4335-9cbe-67e0fddefb19-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:47 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 1073741824" returned: 0 in 1.025s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:47 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 Jul 03 17:46:47 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:47 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561" returned: 0 in 0.851s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3cbeda-28f4-48ad-98d7-f11c9a1f9511]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-5275f49d-87ca-4d44-9433-6cc04fa3bd09-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-5275f49d-87ca-4d44-9433-6cc04fa3bd09-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:47 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 Jul 03 17:46:47 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-quobyte-5275f49d-87ca-4d44-9433-6cc04fa3bd09" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-5275f49d-87ca-4d44-9433-6cc04fa3bd09" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca926ee3-ddfa-4444-baac-621afa95c468]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:48 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 Jul 03 17:46:48 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:48 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46" returned: 0 in 0.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bdccda-ae11-4070-9d57-abc31ef63b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa67266-ce14-4e12-a2ef-3db949c65a46', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052ff3f1-37c2-4a5d-982d-fc33cf02f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Volume volume-faa67266-ce14-4e12-a2ef-3db949c65a46 (faa67266-ce14-4e12-a2ef-3db949c65a46): created successfully Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052ff3f1-37c2-4a5d-982d-fc33cf02f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Flow 'volume_create_manager' (2fe39ed6-cf2f-4994-a820-568a46d47698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:48 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-18e94415-d393-4f89-a771-daafee005193 tempest-CinderUnicodeTest-1859546503 None] Created volume successfully. Jul 03 17:46:48 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" returned: 0 in 0.861s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:48 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 Jul 03 17:46:48 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (b9eb85f7-8926-4fdd-badf-98159e1a88aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9b0abc-2baa-47e6-ae3d-df1f5586e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9b0abc-2baa-47e6-ae3d-df1f5586e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102961199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cf5abe-4c71-4e38-9988-0c80c6c6e361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:49Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4521c66-d08b-4a81-acd1-7229abba4aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4521c66-d08b-4a81-acd1-7229abba4aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001edfee-7f94-4af3-b6bb-f67068e228b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001edfee-7f94-4af3-b6bb-f67068e228b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6cf5abe-4c71-4e38-9988-0c80c6c6e361', 'volume_name': 'volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74314ca2-6160-4133-9ad3-372500aa0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74314ca2-6160-4133-9ad3-372500aa0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314d7a83-a473-4245-a7c1-606580a235c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:48 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Volume a6cf5abe-4c71-4e38-9988-0c80c6c6e361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361', 'volume_size': 1} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102961199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cf5abe-4c71-4e38-9988-0c80c6c6e361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:49Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Creating volume a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:48 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:48 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 1073741824 Jul 03 17:46:48 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:49 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09" returned: 0 in 0.960s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:49 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09 Jul 03 17:46:49 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Flow 'volume_create_manager' (c199bfb7-b777-4354-bdbd-b7c506cba92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3372f773-fe0e-42f2-b1f8-fdb829af6d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3372f773-fe0e-42f2-b1f8-fdb829af6d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-605227864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb48aa6-44c5-40b9-bbe1-e4137b9f6984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29046da3fcdd45a586cd9ad7ddc5b7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:49Z,use_quota=True,user_id='55cc05c7c3684d34a65b94fcefa8bcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4211ee-999e-4a38-8cfe-23a836e22499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4211ee-999e-4a38-8cfe-23a836e22499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7204122-a776-4ddb-a802-239dbc06a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7204122-a776-4ddb-a802-239dbc06a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb48aa6-44c5-40b9-bbe1-e4137b9f6984', 'volume_name': 'volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cde3baa-f088-4130-9b7a-ff91617c1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cde3baa-f088-4130-9b7a-ff91617c1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9ca4d5-2ed9-42bb-8f65-341c04620b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:49 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Volume fcb48aa6-44c5-40b9-bbe1-e4137b9f6984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984', 'volume_size': 1} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:49 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561" returned: 0 in 0.898s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:49 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561 Jul 03 17:46:49 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:49 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 1073741824" returned: 0 in 0.911s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:49 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5275f49d-87ca-4d44-9433-6cc04fa3bd09" returned: 0 in 0.725s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-5275f49d-87ca-4d44-9433-6cc04fa3bd09" released by "delete_volume" :: held 1.745s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:49 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 Jul 03 17:46:49 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created reservations ['10c39b8c-05d3-4883-9a42-5f2c85099503', '2b28df7a-73ef-48aa-a80d-d4eb44188791', '8e972122-2899-4f2f-bd02-3572cccf4798', '33d334d6-b7a4-450a-8430-488f2d138c24'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:49 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:49 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-907b906f-fa57-491b-99f1-5e0ca494466b-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-907b906f-fa57-491b-99f1-5e0ca494466b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:50 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6.cebfd5b8-d54b-463f-bf28-1aa57772b561" returned: 0 in 0.705s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-cebfd5b8-d54b-463f-bf28-1aa57772b561" released by "_delete_snapshot" :: held 3.452s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-quobyte-907b906f-fa57-491b-99f1-5e0ca494466b" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" released by "delete_snapshot" :: held 3.484s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-907b906f-fa57-491b-99f1-5e0ca494466b" acquired by "delete_volume" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff6441-adf0-42c2-8b7e-0e7fc9aabf5b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['c3d6ecb0-7db7-4bce-982e-c597d834d5e2', '556d9445-295e-473d-ad96-22461bcf3e72', '42b57028-5963-47ae-bba5-a70e12c34292', '7d957649-0ba2-4fc4-bfa4-140579636cb5'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Delete snapshot completed successfully. Jul 03 17:46:50 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-453fb029-9cfc-417b-b04d-3b988c59d1e2 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-cebfd5b8-d54b-463f-bf28-1aa57772b561-delete_snapshot" released by "delete_snapshot" :: held 3.687s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:50 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:50 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" returned: 0 in 0.772s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-605227864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb48aa6-44c5-40b9-bbe1-e4137b9f6984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29046da3fcdd45a586cd9ad7ddc5b7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:49Z,use_quota=True,user_id='55cc05c7c3684d34a65b94fcefa8bcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Creating volume fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:46:50 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314d7a83-a473-4245-a7c1-606580a235c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:50 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 1073741824 Jul 03 17:46:50 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67919827-e852-4fa0-82d1-a8397fcce893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:50 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Volume volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 (a6cf5abe-4c71-4e38-9988-0c80c6c6e361): created successfully Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67919827-e852-4fa0-82d1-a8397fcce893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (b9eb85f7-8926-4fdd-badf-98159e1a88aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-47628dd3-3c24-417a-ac08-984793961940 tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:46:50 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Deleted volume successfully. Jul 03 17:46:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-704f5d69-8a41-4339-baad-3ef03efd875f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-5275f49d-87ca-4d44-9433-6cc04fa3bd09-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "cinder-quobyte-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:51 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b" returned: 0 in 0.892s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fced11-0cea-434c-9f4e-8b08ecb45fa1]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:51 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b Jul 03 17:46:51 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:51 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 Jul 03 17:46:51 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:51 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 1073741824" returned: 0 in 0.959s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:51 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 Jul 03 17:46:51 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:51 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-907b906f-fa57-491b-99f1-5e0ca494466b" returned: 0 in 0.667s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-907b906f-fa57-491b-99f1-5e0ca494466b" released by "delete_volume" :: held 1.598s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:51 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created reservations ['abf87105-91f4-4c39-981e-3497284eeb3c', '422ea272-f303-45e8-a00c-52c8168bff0e', '598e9cd8-216b-40c9-afc6-9be96cc85622', 'd2dada1a-63c8-4d8d-9333-b78d643c5bb2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:52 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" returned: 0 in 0.806s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:52 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:52 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:52 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6 Jul 03 17:46:52 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:52 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" returned: 0 in 0.681s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.179s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9ca4d5-2ed9-42bb-8f65-341c04620b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517caa8d-4da4-4e2e-a343-026f743df4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 104a4f2b-cb42-4b76-9b8f-68f074057580 of volume a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:46:52 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Volume volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 (fcb48aa6-44c5-40b9-bbe1-e4137b9f6984): created successfully Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517caa8d-4da4-4e2e-a343-026f743df4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Flow 'volume_create_manager' (c199bfb7-b777-4354-bdbd-b7c506cba92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[55153853-f8a7-45f5-ab87-fd4adabd9644]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-37214246-b1fd-449a-865c-9ce90b8da0fb tempest-CinderUnicodeTest-1859546503 None] Created volume successfully. Jul 03 17:46:52 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 Jul 03 17:46:52 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-4de2c602-4c23-4f9e-9971-3621402e340f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-4de2c602-4c23-4f9e-9971-3621402e340f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-quobyte-4de2c602-4c23-4f9e-9971-3621402e340f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-4de2c602-4c23-4f9e-9971-3621402e340f" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c17e4bb-b3b6-4d5d-896f-3775941416f8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:52 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f Jul 03 17:46:52 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:52 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-quobyte-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6" released by "delete_volume" :: held 1.624s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:52 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.795s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Deleted volume successfully. Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c9a7bd5b-320d-4bcc-8561-ca4f45360ec2 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-907b906f-fa57-491b-99f1-5e0ca494466b-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Created reservations ['f072e5b9-6d7a-4f09-8236-eea4f5d4a6c1', '46bd01e0-ae44-476a-b3f6-981810e2ca98', '22d9ce08-47e5-4baf-9838-1a6138ffb8ce', 'd9414bf7-3377-4fe9-aa29-4e3e16de9879'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:53 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:53 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:53 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" returned: 0 in 0.924s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:53 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 1G Jul 03 17:46:53 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:53 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f" returned: 0 in 0.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:53 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f Jul 03 17:46:53 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:53 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.718s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Deleted volume successfully. Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-97cb52f7-11a9-4f0d-bf55-192a1c8656e6 tempest-CreateVolumesFromSnapshotTest-1434483607 None] Lock "cinder-5fcd16ec-f41b-4e44-9ed4-718f6e2b60b6-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:54 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 1G" returned: 0 in 1.012s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:54 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 Jul 03 17:46:54 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:54 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4de2c602-4c23-4f9e-9971-3621402e340f" returned: 0 in 0.810s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-4de2c602-4c23-4f9e-9971-3621402e340f" released by "delete_volume" :: held 1.701s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created reservations ['1a5efba2-3739-4677-baed-47ea4e32f00a', '0370707e-60f4-4d66-b7b9-4a42c08c869d', 'e69a21ac-3568-4965-a372-dfce06898989', '13f2c140-2b7e-409f-b3bb-e2eb0a3c2124'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:54 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:54 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-quobyte-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf898a3c-5752-413d-9518-86e472039517]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:55 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580" returned: 0 in 0.849s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:55 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 is being set with open permissions: ugo+rw Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:55 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 Jul 03 17:46:55 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:55 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f Jul 03 17:46:55 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:55 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.742s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:55 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Deleted volume successfully. Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-853c6582-c00f-4c76-b006-74184bd6ba9c tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-4de2c602-4c23-4f9e-9971-3621402e340f-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:55 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580" returned: 0 in 0.732s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:55 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f" returned: 0 in 0.791s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:55 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f Jul 03 17:46:55 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:55 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info Jul 03 17:46:55 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:56 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f" returned: 0 in 0.713s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f" released by "delete_volume" :: held 1.555s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:56 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:56 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info is being set with open permissions: ugo+rw Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created reservations ['947a3ce7-299a-4fef-bb41-da03292a3f2a', '0130c4d9-fca7-4fa8-98f8-7ba04d5bddaf', '29760aee-ece1-403d-9af7-60d33b79715c', '9fa24f04-2587-4475-aa60-fd536265b2ec'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:56 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info Jul 03 17:46:56 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Flow 'volume_create_manager' (336645a4-9ac7-4c28-9554-3f1f224694cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1b3ba0-7b04-4429-97b3-f8b07afcef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1b3ba0-7b04-4429-97b3-f8b07afcef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2044694859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc311f7-8728-4027-bba3-5da8cb19ab14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2fc97fa6574da6a8ea352f993490e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:57Z,use_quota=True,user_id='a4516191d3a84710bc9dec524c6a955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8508224-6dd0-4211-b7ae-913335ea5d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8508224-6dd0-4211-b7ae-913335ea5d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0878e67-bdf1-4114-8b88-91ea58fba751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0878e67-bdf1-4114-8b88-91ea58fba751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc311f7-8728-4027-bba3-5da8cb19ab14', 'volume_name': 'volume-efc311f7-8728-4027-bba3-5da8cb19ab14', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4cf706-702f-479c-be33-8a6e125dc96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4cf706-702f-479c-be33-8a6e125dc96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcc816a-981b-4a6e-beb8-78cbd17d2d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:46:56 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Volume efc311f7-8728-4027-bba3-5da8cb19ab14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc311f7-8728-4027-bba3-5da8cb19ab14', 'volume_size': 1} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:56 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:56 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-1e141435-4b0b-4114-8b32-a1c4ad0906b8-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-1e141435-4b0b-4114-8b32-a1c4ad0906b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-quobyte-1e141435-4b0b-4114-8b32-a1c4ad0906b8" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:57 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-1e141435-4b0b-4114-8b32-a1c4ad0906b8" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.info" returned: 0 in 0.675s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.089s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5818a68f-a52f-453b-adfb-d58e4d396c45]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.454s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Creating offline snapshot 2cbe43fa-06df-491b-8136-d3b6312c37d1 of volume fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:46:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f5ce536d-23ab-4c51-9b56-35b051fd1505 tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ecddc3-1028-45e5-a263-4e5e253b2e81]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:57 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 Jul 03 17:46:57 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:57 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.689s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Deleted volume successfully. Jul 03 17:46:57 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 Jul 03 17:46:57 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-5b6807fd-a6a5-4c17-b990-20ad5b70c36b tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-9d41f790-f72e-4f63-a63f-8f81eb3d3d7f-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:58 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8" returned: 0 in 0.799s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:58 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" returned: 0 in 0.760s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:58 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8 Jul 03 17:46:58 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:58 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 1G Jul 03 17:46:58 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-104a4f2b-cb42-4b76-9b8f-68f074057580-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Lock "cinder-104a4f2b-cb42-4b76-9b8f-68f074057580-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-104a4f2b-cb42-4b76-9b8f-68f074057580" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-104a4f2b-cb42-4b76-9b8f-68f074057580" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 104a4f2b-cb42-4b76-9b8f-68f074057580 of volume a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5872d7-4c21-4d3a-9cdf-fed1ad13b446]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:58 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 Jul 03 17:46:58 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:58 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1e141435-4b0b-4114-8b32-a1c4ad0906b8" returned: 0 in 0.638s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-1e141435-4b0b-4114-8b32-a1c4ad0906b8" released by "delete_volume" :: held 1.491s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created reservations ['436e3e83-82ff-4192-a73a-7c66b081e249', '742e04bd-f884-4c86-8791-6b859c2eaf8d', '2b670b2b-498e-40b0-a316-9ddfee746cd6', '9c0f6a40-c01a-45f6-b329-d48e20777284'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:58 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:46:58 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:58 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 1G" returned: 0 in 0.851s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:59 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 Jul 03 17:46:59 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:59 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580" returned: 0 in 0.762s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1406ecb-0da3-4057-977d-beb3e55f9c44]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:59 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 Jul 03 17:46:59 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-896481ea-c697-4aa5-81b9-58dc12e16a63-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-896481ea-c697-4aa5-81b9-58dc12e16a63-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:59 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "cinder-quobyte-896481ea-c697-4aa5-81b9-58dc12e16a63" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.678s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:46:59 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Deleted volume successfully. Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-896481ea-c697-4aa5-81b9-58dc12e16a63" acquired by "delete_volume" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c26941e-2b5e-4d31-8b7c-6ab21dfa6596]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cc5eb97c-dc7e-4681-a415-b0c1776a807f tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-1e141435-4b0b-4114-8b32-a1c4ad0906b8-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:46:59 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 Jul 03 17:46:59 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:46:59 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1" returned: 0 in 0.776s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:46:59 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 is being set with open permissions: ugo+rw Jul 03 17:46:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:46:59 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 Jul 03 17:46:59 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:00 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" returned: 0 in 0.826s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:00 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 Jul 03 17:47:00 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:00 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1" returned: 0 in 0.644s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:00 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63" returned: 0 in 0.797s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:00 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63 Jul 03 17:47:00 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:00 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info Jul 03 17:47:00 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:00 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580" returned: 0 in 0.800s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:00 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580 Jul 03 17:47:00 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:01 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-896481ea-c697-4aa5-81b9-58dc12e16a63" returned: 0 in 0.653s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-quobyte-896481ea-c697-4aa5-81b9-58dc12e16a63" released by "delete_volume" :: held 1.495s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:01 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info" returned: 0 in 0.664s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:01 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info is being set with open permissions: ugo+rw Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:01 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info Jul 03 17:47:01 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Created reservations ['fd78c771-343d-43a2-a5a1-c488a00ffa5e', '2eaa14b1-2d7d-4bd8-b8e3-d13c8aba0df2', 'd527567d-c63b-434f-aa93-c2cf21a0de87', 'd9fb6f5f-3dd1-465b-bb8c-c5e150501567'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:01 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:01 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:01 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361.104a4f2b-cb42-4b76-9b8f-68f074057580" returned: 0 in 0.693s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-104a4f2b-cb42-4b76-9b8f-68f074057580" released by "_delete_snapshot" :: held 3.194s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" released by "delete_snapshot" :: held 3.215s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Created reservations ['a5b862e7-5b9d-4215-8d59-d89384735ae4', '788179f5-7091-4ba0-bc35-be9f53dcb4bc', 'a81b2e27-5d37-4776-95c0-24758550cf39', '69f8dea5-8dde-48c9-adbc-1c47ca9ba335'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fd7ccc92-07cf-49b0-87cb-ec02f3072d19 tempest-ProjectMemberTests-725070442 None] Lock "cinder-104a4f2b-cb42-4b76-9b8f-68f074057580-delete_snapshot" released by "delete_snapshot" :: held 3.386s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:01 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.info" returned: 0 in 0.666s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.070s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2044694859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc311f7-8728-4027-bba3-5da8cb19ab14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2fc97fa6574da6a8ea352f993490e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:46:57Z,use_quota=True,user_id='a4516191d3a84710bc9dec524c6a955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Creating volume efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:01 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:01 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 1073741824 Jul 03 17:47:01 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fa1bf89a-e9d3-4a3b-b4d2-d8f5e2e2c6dc tempest-CinderUnicodeTest-1859546503 None] Create snapshot completed successfully Jul 03 17:47:01 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.754s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:01 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:02 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Deleted volume successfully. Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-66d3c0fe-719a-4875-88ad-fe72a035e277 tempest-CreateVolumesFromSourceVolumeTest-1849880006 None] Lock "cinder-896481ea-c697-4aa5-81b9-58dc12e16a63-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-2cbe43fa-06df-491b-8136-d3b6312c37d1-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-2cbe43fa-06df-491b-8136-d3b6312c37d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-quobyte-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-quobyte-2cbe43fa-06df-491b-8136-d3b6312c37d1" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-2cbe43fa-06df-491b-8136-d3b6312c37d1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Deleting offline snapshot 2cbe43fa-06df-491b-8136-d3b6312c37d1 of volume fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] snapshot_file for this snap is: volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c720bd96-6fbe-46c5-87b0-c23d32b89feb]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:02 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 Jul 03 17:47:02 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-a6cf5abe-4c71-4e38-9988-0c80c6c6e361-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Lock "cinder-a6cf5abe-4c71-4e38-9988-0c80c6c6e361-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:02 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 1073741824" returned: 0 in 1.050s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8ef26-4a7c-4d50-bde9-425d11d92c6e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:03 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:03 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:03 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 Jul 03 17:47:03 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:03 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1" returned: 0 in 1.181s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e93ec2-8ad1-4b09-b53b-970948b350e5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:03 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 Jul 03 17:47:03 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:03 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=240,cinder:SELECT=176,cinder:INSERT=66,cinder:DELETE=22 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcc816a-981b-4a6e-beb8-78cbd17d2d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc311f7-8728-4027-bba3-5da8cb19ab14', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a221d7a1-8aa5-44f7-8d8d-b66a3b18ce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:03 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Volume volume-efc311f7-8728-4027-bba3-5da8cb19ab14 (efc311f7-8728-4027-bba3-5da8cb19ab14): created successfully Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a221d7a1-8aa5-44f7-8d8d-b66a3b18ce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Flow 'volume_create_manager' (336645a4-9ac7-4c28-9554-3f1f224694cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4aa0f211-4f86-4663-af07-88f883b1f453 tempest-VolumeDependencyTests-215626243 None] Created volume successfully. Jul 03 17:47:03 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" returned: 0 in 1.067s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:03 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361 Jul 03 17:47:03 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=175,cinder:UPDATE=242,cinder:INSERT=63,cinder:DELETE=23 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Creating offline snapshot b37d14c7-3313-4616-beaa-3d8857eb9822 of volume efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c64b0-63e8-4c8b-9b66-ea0d67541ef6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:04 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" returned: 0 in 0.966s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:04 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 Jul 03 17:47:04 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:04 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:04 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:04 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" returned: 0 in 0.781s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-a6cf5abe-4c71-4e38-9988-0c80c6c6e361" released by "delete_volume" :: held 1.949s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Created reservations ['647a6a03-3cec-4c71-af56-4bd0ecdb2ac9', '86ab06e0-92e9-4c19-bb60-0fd2d9c8ac73', 'd60ee8b8-33ce-4897-ba6b-b9dfd237e748', '4c81cc08-313b-4dc9-8884-fe4b787fbeab'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:05 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:05 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:05 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1" returned: 0 in 1.058s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:05 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1 Jul 03 17:47:05 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:05 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 1.161s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:05 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 1G Jul 03 17:47:05 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:05 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.823s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (9b255772-1410-43dd-8bf5-f9e9fc6b2ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fbe358-24c5-471f-a1b6-7b2c91a866cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fbe358-24c5-471f-a1b6-7b2c91a866cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877710443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a49d5d-d7e0-4060-ad34-50cd1d374fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:06Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3bf185-bbc1-45d9-9680-b3a9c1e29a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3bf185-bbc1-45d9-9680-b3a9c1e29a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80f3fcd-9f49-4d5c-8a1e-420e218519ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80f3fcd-9f49-4d5c-8a1e-420e218519ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a49d5d-d7e0-4060-ad34-50cd1d374fb9', 'volume_name': 'volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0305cb-d0f7-40b0-a8d4-c4e68ce5d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0305cb-d0f7-40b0-a8d4-c4e68ce5d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59efbb30-31b7-41fa-a321-8286538c1951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Volume e7a49d5d-d7e0-4060-ad34-50cd1d374fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9', 'volume_size': 1} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f9dcbda1-c26a-4287-8397-0dea77f1b744 tempest-ProjectMemberTests-725070442 None] Lock "cinder-a6cf5abe-4c71-4e38-9988-0c80c6c6e361-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3ec1882c-9c56-4f7c-8e28-763bb9d37287 tempest-ProjectAdminTests-1265112274 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7351341247559, 'free_capacity_gb': 1775.7351341247559, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86621) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 17:47:06 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984.2cbe43fa-06df-491b-8136-d3b6312c37d1" returned: 0 in 0.671s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-2cbe43fa-06df-491b-8136-d3b6312c37d1" released by "_delete_snapshot" :: held 4.001s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" released by "delete_snapshot" :: held 4.032s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Created reservations ['b2fd9c3e-d174-4f38-8031-cf62a73c9398', 'ad861782-6601-46b9-93b9-49e3c43b8fc6', '35eb265e-36cd-4f3c-8770-d1231e00a612', '508100a5-c12e-4cde-9e33-44c37544b02a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Delete snapshot completed successfully. Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6318ea97-8dc3-49e6-bb19-f52b3218b5d9 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-2cbe43fa-06df-491b-8136-d3b6312c37d1-delete_snapshot" released by "delete_snapshot" :: held 4.197s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:06 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 1G" returned: 0 in 0.896s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc311f7-8728-4027-bba3-5da8cb19ab14 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:06 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc311f7-8728-4027-bba3-5da8cb19ab14 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 Jul 03 17:47:06 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-quobyte-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a68a71b-16e3-409c-9bcf-eec73b42bbf7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:06 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 Jul 03 17:47:06 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:07 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc311f7-8728-4027-bba3-5da8cb19ab14 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822" returned: 0 in 0.704s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:07 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 is being set with open permissions: ugo+rw Jul 03 17:47:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:07 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 Jul 03 17:47:07 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:07 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" returned: 0 in 0.809s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:07 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984 Jul 03 17:47:07 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:08 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822" returned: 0 in 0.725s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:08 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info Jul 03 17:47:08 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:08 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" returned: 0 in 0.786s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984" released by "delete_volume" :: held 1.681s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Created reservations ['131aa780-8540-4f7c-aa2f-274c5434ff16', '234c11c2-0661-4cf7-8ef3-e58c4b02411f', '28df57ca-dad9-4645-9231-eb75a989c6f0', '71d23aaa-12a2-4777-8088-6cb917ff3176'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:08 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:08 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:08 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info" returned: 0 in 0.679s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:08 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info is being set with open permissions: ugo+rw Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:08 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info Jul 03 17:47:08 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-faa67266-ce14-4e12-a2ef-3db949c65a46-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-faa67266-ce14-4e12-a2ef-3db949c65a46-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "cinder-quobyte-faa67266-ce14-4e12-a2ef-3db949c65a46" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-faa67266-ce14-4e12-a2ef-3db949c65a46" acquired by "delete_volume" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1874a3-94ac-4c44-a5b8-fc2a8d8cc591]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:09 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 Jul 03 17:47:09 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:09 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Deleted volume successfully. Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-82c2a493-86f7-40b3-8fee-c40430ad0f35 tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-fcb48aa6-44c5-40b9-bbe1-e4137b9f6984-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:09 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.info" returned: 0 in 0.723s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.024s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.619s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877710443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a49d5d-d7e0-4060-ad34-50cd1d374fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:06Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Creating volume e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:09 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:09 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 1073741824 Jul 03 17:47:09 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:09 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-316c1478-e99f-424f-aa04-b4fee2c9cd8d tempest-VolumeDependencyTests-215626243 None] Create snapshot completed successfully Jul 03 17:47:09 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46" returned: 0 in 0.807s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:09 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46 Jul 03 17:47:09 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:10 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 1073741824" returned: 0 in 1.016s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:10 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 Jul 03 17:47:10 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:10 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-faa67266-ce14-4e12-a2ef-3db949c65a46" returned: 0 in 0.786s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-quobyte-faa67266-ce14-4e12-a2ef-3db949c65a46" released by "delete_volume" :: held 1.643s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Flow 'volume_create_manager' (51095342-c3ed-430e-80fc-c9cef38ad26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ba2673-f7e3-47c8-bdee-861f7caa6e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Created reservations ['2f7275c8-eaca-48ee-93d4-b912381d714e', '820d39cd-881c-4f08-8a08-342a1dfc6fc4', 'e2a21e02-11d1-444e-b83a-da2b701d788b', 'd322e729-6059-4d6f-a0ac-782e15ae9281'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ba2673-f7e3-47c8-bdee-861f7caa6e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1772150941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e23565-1f26-4837-a2a1-2e543114210e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2fc97fa6574da6a8ea352f993490e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b37d14c7-3313-4616-beaa-3d8857eb9822,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:11Z,use_quota=True,user_id='a4516191d3a84710bc9dec524c6a955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fc5b9d-12c5-42e0-a7ef-449e3eaaeae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fc5b9d-12c5-42e0-a7ef-449e3eaaeae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5abaae6-af8b-404b-8b83-d5e69a22fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5abaae6-af8b-404b-8b83-d5e69a22fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '10e23565-1f26-4837-a2a1-2e543114210e', 'volume_name': 'volume-10e23565-1f26-4837-a2a1-2e543114210e', 'volume_size': 1, 'snapshot_id': 'b37d14c7-3313-4616-beaa-3d8857eb9822'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564f1078-8e85-4b3c-9ba2-8d77c22f1aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564f1078-8e85-4b3c-9ba2-8d77c22f1aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698fab12-c5f6-4018-af87-2f670c796d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Volume 10e23565-1f26-4837-a2a1-2e543114210e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-10e23565-1f26-4837-a2a1-2e543114210e', 'volume_size': 1, 'snapshot_id': 'b37d14c7-3313-4616-beaa-3d8857eb9822'} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (0d1f216d-65c7-46d4-8c1b-3d021cea33aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca843cc4-1a1b-4594-89f2-3b5fd92f1979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca843cc4-1a1b-4594-89f2-3b5fd92f1979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339916989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed8bc14-c64b-4c85-96eb-0f9b748cd67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:11Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfea48f8-cf2f-465d-b63c-bbe776515ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfea48f8-cf2f-465d-b63c-bbe776515ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e38fa8-09f3-4892-b960-f93b7d30f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e38fa8-09f3-4892-b960-f93b7d30f20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed8bc14-c64b-4c85-96eb-0f9b748cd67a', 'volume_name': 'volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21386b8-9776-4fa0-a0af-6db31a658da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21386b8-9776-4fa0-a0af-6db31a658da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c50e706-750e-4b41-93a0-fccadad94da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Volume 2ed8bc14-c64b-4c85-96eb-0f9b748cd67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a', 'volume_size': 1} Jul 03 17:47:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:11 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:11 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:11 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" returned: 0 in 0.638s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.293s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-quobyte-b37d14c7-3313-4616-beaa-3d8857eb9822-10e23565-1f26-4837-a2a1-2e543114210e" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59efbb30-31b7-41fa-a321-8286538c1951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59abdba4-aaaa-42ed-8df5-298cac488e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Volume volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 (e7a49d5d-d7e0-4060-ad34-50cd1d374fb9): created successfully Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59abdba4-aaaa-42ed-8df5-298cac488e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (9b255772-1410-43dd-8bf5-f9e9fc6b2ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-b37d14c7-3313-4616-beaa-3d8857eb9822-10e23565-1f26-4837-a2a1-2e543114210e" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Creating volume 10e23565-1f26-4837-a2a1-2e543114210e from snapshot b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-quobyte-10e23565-1f26-4837-a2a1-2e543114210e" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-39e6cafe-b0b1-45b0-a1a9-b145398fbb3b tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-10e23565-1f26-4837-a2a1-2e543114210e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] snapshot: b37d14c7-3313-4616-beaa-3d8857eb9822, volume: 10e23565-1f26-4837-a2a1-2e543114210e, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[51484008-0017-4d11-bb94-f6fd5af5ddeb]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:11 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 Jul 03 17:47:11 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:11 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.692s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Deleted volume successfully. Jul 03 17:47:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c3cf4896-4aab-4aa6-8ed7-f394cc050bbb tempest-CinderUnicodeTest-1859546503 None] Lock "cinder-faa67266-ce14-4e12-a2ef-3db949c65a46-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:12 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822" returned: 0 in 0.840s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efc311f7-8728-4027-bba3-5da8cb19ab14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ce1d90-d69f-4f2f-9010-318239f85e1a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:12 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:12 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:13 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 0.820s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:13 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:47:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:13 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e Jul 03 17:47:13 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:18 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e" returned: 0 in 5.007s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:18 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ecb1d-c4f0-4ee5-8a8d-e4bd431cb7e7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:18 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:18 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:18 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 0.915s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:18 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:47:18 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Converted 1024.00 MB image at 204.48 MB/s Jul 03 17:47:18 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e is being set with open permissions: ugo+rw Jul 03 17:47:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:19 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e Jul 03 17:47:19 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:19 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-10e23565-1f26-4837-a2a1-2e543114210e" released by "_copy_volume_from_snapshot" :: held 8.322s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-b37d14c7-3313-4616-beaa-3d8857eb9822-10e23565-1f26-4837-a2a1-2e543114210e" released by "_create_volume_from_snapshot" :: held 8.353s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.407s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.643s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339916989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed8bc14-c64b-4c85-96eb-0f9b748cd67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:11Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Creating volume 2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:19 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:19 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a 1073741824 Jul 03 17:47:19 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698fab12-c5f6-4018-af87-2f670c796d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e23565-1f26-4837-a2a1-2e543114210e', 'volume_size': 1, 'snapshot_id': 'b37d14c7-3313-4616-beaa-3d8857eb9822'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94a3f45-4844-4fe6-af4a-3b75fa9f3f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:19 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Volume volume-10e23565-1f26-4837-a2a1-2e543114210e (10e23565-1f26-4837-a2a1-2e543114210e): created successfully Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94a3f45-4844-4fe6-af4a-3b75fa9f3f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:19 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Flow 'volume_create_manager' (51095342-c3ed-430e-80fc-c9cef38ad26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:19 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-20a25645-58c9-49b1-a4c4-c453a93a47b1 tempest-VolumeDependencyTests-215626243 None] Created volume successfully. Jul 03 17:47:20 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a 1073741824" returned: 0 in 0.879s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:20 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a Jul 03 17:47:20 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-b37d14c7-3313-4616-beaa-3d8857eb9822-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-b37d14c7-3313-4616-beaa-3d8857eb9822-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-quobyte-efc311f7-8728-4027-bba3-5da8cb19ab14" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-efc311f7-8728-4027-bba3-5da8cb19ab14" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-quobyte-b37d14c7-3313-4616-beaa-3d8857eb9822" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-b37d14c7-3313-4616-beaa-3d8857eb9822" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Deleting offline snapshot b37d14c7-3313-4616-beaa-3d8857eb9822 of volume efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] snapshot_file for this snap is: volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe6a032-294c-4bf0-bd7d-57f51822a53a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:20 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 Jul 03 17:47:20 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:21 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" returned: 0 in 0.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.911s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c50e706-750e-4b41-93a0-fccadad94da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99be28c3-1966-4d50-9b1d-7e399413bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 33f74bab-7ab9-4966-b0e5-5a8108610e45 of volume e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:47:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Volume volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a (2ed8bc14-c64b-4c85-96eb-0f9b748cd67a): created successfully Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99be28c3-1966-4d50-9b1d-7e399413bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (0d1f216d-65c7-46d4-8c1b-3d021cea33aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f53a520-7dec-4215-b091-411e9b5d3af5]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:21 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-84533cca-fa0d-4695-bc81-4bff3d6607df tempest-ProjectReaderTests-1928166671 None] Created volume successfully. Jul 03 17:47:21 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 Jul 03 17:47:21 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:21 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822" returned: 0 in 0.781s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efc311f7-8728-4027-bba3-5da8cb19ab14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b607f12-d975-4d9d-858e-7fc7c9f4214f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:21 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:21 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:22 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:22 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 1G Jul 03 17:47:22 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:22 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 0.834s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:22 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 Jul 03 17:47:22 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:23 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 1G" returned: 0 in 0.937s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:23 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 Jul 03 17:47:23 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:23 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822" returned: 0 in 0.842s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:23 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822 Jul 03 17:47:23 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:23 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:23 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 is being set with open permissions: ugo+rw Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:23 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 Jul 03 17:47:23 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:23 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14.b37d14c7-3313-4616-beaa-3d8857eb9822" returned: 0 in 0.692s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-b37d14c7-3313-4616-beaa-3d8857eb9822" released by "_delete_snapshot" :: held 3.253s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-efc311f7-8728-4027-bba3-5da8cb19ab14" released by "delete_snapshot" :: held 3.275s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:23 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Created reservations ['a6dce574-5c44-4253-a6df-aed2c072efdf', 'a51e2d66-df70-441a-ad54-3ffd0513bab4', '024c4b8d-9d84-4652-9cac-3154d04e629b', '85d109e5-3fc8-4116-be8e-68ced45dd7a9'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:24 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Delete snapshot completed successfully. Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-492ed2b1-dab6-4c57-a4f2-0ef1033ed4b0 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-b37d14c7-3313-4616-beaa-3d8857eb9822-delete_snapshot" released by "delete_snapshot" :: held 3.426s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:24 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45" returned: 0 in 0.666s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:24 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info Jul 03 17:47:24 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-efc311f7-8728-4027-bba3-5da8cb19ab14-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-efc311f7-8728-4027-bba3-5da8cb19ab14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-quobyte-efc311f7-8728-4027-bba3-5da8cb19ab14" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-efc311f7-8728-4027-bba3-5da8cb19ab14" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:24 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d8cfcf-0429-4fe5-bf59-340e4f2d3c56]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:25 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:25 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:25 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info" returned: 0 in 0.673s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:25 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info is being set with open permissions: ugo+rw Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:25 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info Jul 03 17:47:25 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:25 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 0.743s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:25 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.info" returned: 0 in 0.627s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:25 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14 Jul 03 17:47:25 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.541s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.042s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Creating offline snapshot f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e of volume 2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:47:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-8490a09a-59c0-45ec-8d90-d884444db567 tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[802e9acf-fb97-41cc-a86e-7e1aada2ea73]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:25 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a Jul 03 17:47:25 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-33f74bab-7ab9-4966-b0e5-5a8108610e45-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Lock "cinder-33f74bab-7ab9-4966-b0e5-5a8108610e45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-33f74bab-7ab9-4966-b0e5-5a8108610e45" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-33f74bab-7ab9-4966-b0e5-5a8108610e45" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 33f74bab-7ab9-4966-b0e5-5a8108610e45 of volume e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[496dfbec-0255-431e-8c52-4a8aace3ae21]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:26 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 Jul 03 17:47:26 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:26 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-efc311f7-8728-4027-bba3-5da8cb19ab14" returned: 0 in 0.770s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-efc311f7-8728-4027-bba3-5da8cb19ab14" released by "delete_volume" :: held 1.578s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Created reservations ['72ef3441-a8d4-4fd4-8480-f0dfb2dbb3d2', '6593da7c-12d9-43d1-a9c1-30ce9283b8e1', '7d6d8fa5-f4b9-453d-803c-b1e68ea4ad05', '788b536c-fda2-462b-aeba-7c636198c7dc'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:26 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:26 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:26 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" returned: 0 in 0.973s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:26 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e 1G Jul 03 17:47:26 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:27 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45" returned: 0 in 0.968s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-10e23565-1f26-4837-a2a1-2e543114210e-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9cf1d2-a768-4ba3-97b8-dcc69517d7b6]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-10e23565-1f26-4837-a2a1-2e543114210e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "cinder-quobyte-10e23565-1f26-4837-a2a1-2e543114210e" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-10e23565-1f26-4837-a2a1-2e543114210e" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea1f81-98f4-4e5e-8b97-d8c55db51ebe]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:27 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 Jul 03 17:47:27 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:27 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e Jul 03 17:47:27 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:27 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.918s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Deleted volume successfully. Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-04b50e0c-af95-4976-8aa0-42fb9c6acc04 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-efc311f7-8728-4027-bba3-5da8cb19ab14-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:27 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e 1G" returned: 0 in 1.153s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:27 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e Jul 03 17:47:28 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:28 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" returned: 0 in 1.078s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:28 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e" returned: 0 in 0.927s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:28 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 Jul 03 17:47:28 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:28 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e Jul 03 17:47:28 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:28 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" returned: 0 in 0.817s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:28 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e is being set with open permissions: ugo+rw Jul 03 17:47:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:28 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e Jul 03 17:47:28 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:29 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-10e23565-1f26-4837-a2a1-2e543114210e" returned: 0 in 0.721s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-quobyte-10e23565-1f26-4837-a2a1-2e543114210e" released by "delete_volume" :: held 1.715s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Created reservations ['75e78d9f-282f-4495-b1cb-5e868fb44bb1', 'b2a6df9f-17b4-4cb7-b092-4157ca0bbc8a', 'e2b4f68a-fd49-44dd-86fe-6408e445ef74', 'e453fe03-70ac-4cf6-b806-811c1b77e925'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:29 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45" returned: 0 in 0.930s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:29 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:29 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:29 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45 Jul 03 17:47:29 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:29 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" returned: 0 in 0.793s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:29 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info Jul 03 17:47:29 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:30 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.816s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Deleted volume successfully. Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3f1ff844-ba7b-4ed1-8b04-a35d70e26eb5 tempest-VolumeDependencyTests-215626243 None] Lock "cinder-10e23565-1f26-4837-a2a1-2e543114210e-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:30 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9.33f74bab-7ab9-4966-b0e5-5a8108610e45" returned: 0 in 0.890s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-33f74bab-7ab9-4966-b0e5-5a8108610e45" released by "_delete_snapshot" :: held 4.026s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" released by "delete_snapshot" :: held 4.054s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Created reservations ['3ddc54c2-dbde-4ec4-ab81-5fe8b3995e3b', '52665b86-9289-4b91-a6c1-b79729c26d20', '9da6b887-4e9c-4c46-b60c-f9c5c15654fa', 'c7c92556-bfb0-435b-af60-c20b0f2e09b3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3b063e42-5291-4a8a-b344-78d0e9c0de3f tempest-ProjectMemberTests-725070442 None] Lock "cinder-33f74bab-7ab9-4966-b0e5-5a8108610e45-delete_snapshot" released by "delete_snapshot" :: held 4.276s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:30 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info" returned: 0 in 0.857s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:30 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info is being set with open permissions: ugo+rw Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:30 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info Jul 03 17:47:30 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Flow 'volume_create_manager' (dc19b097-33e7-446e-8572-dfc4776012ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca172e1f-4947-4d56-a630-f86b8d475da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca172e1f-4947-4d56-a630-f86b8d475da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723252994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f23b1d-c62f-4d0e-b282-11f580dadc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee503d862543416097060a57b49a8adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:30Z,use_quota=True,user_id='e502563c91124ed9b15081e5160b6c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76057413-f5a9-4e7d-8c0e-5925db3c86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76057413-f5a9-4e7d-8c0e-5925db3c86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449a1702-e090-4d06-bc68-48d29b6cf33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449a1702-e090-4d06-bc68-48d29b6cf33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f23b1d-c62f-4d0e-b282-11f580dadc06', 'volume_name': 'volume-98f23b1d-c62f-4d0e-b282-11f580dadc06', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91426f7-b807-4bd3-8985-ff304a2e3f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91426f7-b807-4bd3-8985-ff304a2e3f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4582d5-2bff-463d-a269-48b8ee26bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Volume 98f23b1d-c62f-4d0e-b282-11f580dadc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f23b1d-c62f-4d0e-b282-11f580dadc06', 'volume_size': 1} Jul 03 17:47:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:31 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.info" returned: 0 in 0.681s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.389s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723252994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f23b1d-c62f-4d0e-b282-11f580dadc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee503d862543416097060a57b49a8adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:30Z,use_quota=True,user_id='e502563c91124ed9b15081e5160b6c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Creating volume 98f23b1d-c62f-4d0e-b282-11f580dadc06 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:31 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:31 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 1073741824 Jul 03 17:47:31 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e9b1364f-519a-405a-a3b2-0797e1655e1c tempest-ProjectReaderTests-1928166671 None] Create snapshot completed successfully Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Lock "cinder-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bae658-45b4-4b76-8d18-fb4667b424a2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:31 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 Jul 03 17:47:31 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:32 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 1073741824" returned: 0 in 0.858s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:32 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 Jul 03 17:47:32 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:32 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" returned: 0 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:32 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9 Jul 03 17:47:32 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Deleting offline snapshot f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e of volume 2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] snapshot_file for this snap is: volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f90de66-1965-4d8f-8040-1c46041b2b49]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:32 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e Jul 03 17:47:32 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:32 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06" returned: 0 in 0.868s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4582d5-2bff-463d-a269-48b8ee26bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f23b1d-c62f-4d0e-b282-11f580dadc06', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657a20e6-582e-4d02-adb1-417a0a4f4b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:33 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Volume volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 (98f23b1d-c62f-4d0e-b282-11f580dadc06): created successfully Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657a20e6-582e-4d02-adb1-417a0a4f4b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Flow 'volume_create_manager' (dc19b097-33e7-446e-8572-dfc4776012ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:33 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2a6a6f87-8d48-4bca-bd7e-cf046b85dedc tempest-ProjectReaderTests-1909689210 None] Created volume successfully. Jul 03 17:47:33 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" returned: 0 in 0.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9" released by "delete_volume" :: held 1.706s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Created reservations ['7d33121b-9c85-4961-8a7c-dc386888f701', 'c92b4b0b-1dbf-4fd2-8c44-d8fb6d02798d', '507f0970-fe75-43e0-9274-c1e370e668b7', 'd097ad99-7ee6-41e0-9ea9-9d21775599d8'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:33 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:33 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:33 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" returned: 0 in 0.841s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcadf9c-5992-4798-8635-7b0e66aa739a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:33 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a Jul 03 17:47:33 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Acquiring lock "cinder-98f23b1d-c62f-4d0e-b282-11f580dadc06-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Lock "cinder-98f23b1d-c62f-4d0e-b282-11f580dadc06-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Acquiring lock "cinder-quobyte-98f23b1d-c62f-4d0e-b282-11f580dadc06" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Lock "cinder-quobyte-98f23b1d-c62f-4d0e-b282-11f580dadc06" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733419f-a036-45eb-8171-9938b3060aad]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:34 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 Jul 03 17:47:34 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:34 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.852s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4ba35631-4ffd-4811-9d64-5d1b06991e0d tempest-ProjectMemberTests-725070442 None] Lock "cinder-e7a49d5d-d7e0-4060-ad34-50cd1d374fb9-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (4a84227d-c691-4345-a63c-06d1b4f64d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc7e361-8b71-4eca-bfb9-cc092f328a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc7e361-8b71-4eca-bfb9-cc092f328a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402606829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1869eb-47aa-432b-b1ad-44e2b2b5c6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:34Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b8ff0c-531f-408a-897b-5e9d6075ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b8ff0c-531f-408a-897b-5e9d6075ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebffb46-2a27-49dc-bcc4-e9702b875823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebffb46-2a27-49dc-bcc4-e9702b875823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1869eb-47aa-432b-b1ad-44e2b2b5c6be', 'volume_name': 'volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688bb243-5b77-4b52-b8e3-d31e52d21ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688bb243-5b77-4b52-b8e3-d31e52d21ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694e6b66-06fa-4da9-8949-c4c2841423f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:34 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Volume ab1869eb-47aa-432b-b1ad-44e2b2b5c6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be', 'volume_size': 1} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402606829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1869eb-47aa-432b-b1ad-44e2b2b5c6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:34Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Creating volume ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:34 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:34 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be 1073741824 Jul 03 17:47:34 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:34 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" returned: 0 in 0.946s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:34 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e Jul 03 17:47:34 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:34 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06" returned: 0 in 0.892s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:34 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06 Jul 03 17:47:35 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:35 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" returned: 0 in 0.839s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:35 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e Jul 03 17:47:35 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:35 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be 1073741824" returned: 0 in 0.995s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:35 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be Jul 03 17:47:35 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:35 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-98f23b1d-c62f-4d0e-b282-11f580dadc06" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Lock "cinder-quobyte-98f23b1d-c62f-4d0e-b282-11f580dadc06" released by "delete_volume" :: held 1.833s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Created reservations ['1930b39c-a5c0-4036-8a8e-9b98c74584ff', '8ef623d4-372c-4034-93ef-275963674fa1', '3caf942b-fd40-48da-bcae-388046067a79', 'c3340159-d680-4abe-afde-fb5c6c8a720f'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:35 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:35 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:36 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a.f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" returned: 0 in 0.735s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e" released by "_delete_snapshot" :: held 3.495s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" released by "delete_snapshot" :: held 3.530s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Created reservations ['365983b4-4272-476b-b4d1-c433e55af538', 'c9938fb8-020b-436f-a68d-6e397b8be1d8', '3eddbf53-c651-4d0b-9e7b-56a7c3d60b69', '3f0df402-4312-44a3-ad17-966df9bb2199'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Delete snapshot completed successfully. Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6331581d-c5dd-4c58-bd61-0283035b11b4 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-f7d1cf15-2a0f-4aa6-9f8e-6de0d581592e-delete_snapshot" released by "delete_snapshot" :: held 3.707s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:36 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" returned: 0 in 0.812s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694e6b66-06fa-4da9-8949-c4c2841423f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9aa133-c305-44ad-a38a-c51430465de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Volume volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be (ab1869eb-47aa-432b-b1ad-44e2b2b5c6be): created successfully Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9aa133-c305-44ad-a38a-c51430465de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (4a84227d-c691-4345-a63c-06d1b4f64d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-98de3e78-4601-40e9-bff1-fcff9723bdc1 tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:36 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Flow 'volume_create_manager' (4c79fc78-7c6c-4005-b9a0-f6b0347fb7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19d60d7-915d-482c-b31d-e212ebfa3a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.696s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Deleted volume successfully. Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19d60d7-915d-482c-b31d-e212ebfa3a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224508180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53a0697-4c54-48ce-b904-53bbd407c301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee503d862543416097060a57b49a8adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:37Z,use_quota=True,user_id='e502563c91124ed9b15081e5160b6c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed69383-8f50-40aa-8d58-60c559804042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed69383-8f50-40aa-8d58-60c559804042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d047f3-3a56-4947-973d-727df11121c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d047f3-3a56-4947-973d-727df11121c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53a0697-4c54-48ce-b904-53bbd407c301', 'volume_name': 'volume-b53a0697-4c54-48ce-b904-53bbd407c301', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a881502e-d627-4050-9cb3-1479e8e47797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a881502e-d627-4050-9cb3-1479e8e47797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bf4a2b-b444-45ab-b92d-078446950b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Volume b53a0697-4c54-48ce-b904-53bbd407c301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53a0697-4c54-48ce-b904-53bbd407c301', 'volume_size': 1} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224508180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53a0697-4c54-48ce-b904-53bbd407c301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee503d862543416097060a57b49a8adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:37Z,use_quota=True,user_id='e502563c91124ed9b15081e5160b6c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Creating volume b53a0697-4c54-48ce-b904-53bbd407c301 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:36 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-676a6451-42b0-409b-b8d1-defa9c61e5bf tempest-ProjectReaderTests-1909689210 None] Lock "cinder-98f23b1d-c62f-4d0e-b282-11f580dadc06-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:36 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 1073741824 Jul 03 17:47:36 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1ee29a-b935-4c24-b4cb-58cc53daa9ec]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:37 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a Jul 03 17:47:37 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:37 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 1073741824" returned: 0 in 1.014s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:37 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 Jul 03 17:47:37 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:37 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" returned: 0 in 0.937s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:37 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a Jul 03 17:47:37 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:38 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301" returned: 0 in 0.636s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.390s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bf4a2b-b444-45ab-b92d-078446950b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53a0697-4c54-48ce-b904-53bbd407c301', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27d91de-78e6-4a2f-b4e4-46d54ae2d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Creating offline snapshot c45a89b4-7e62-45f4-95a5-edd1a9728452 of volume ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:47:38 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Volume volume-b53a0697-4c54-48ce-b904-53bbd407c301 (b53a0697-4c54-48ce-b904-53bbd407c301): created successfully Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27d91de-78e6-4a2f-b4e4-46d54ae2d160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Flow 'volume_create_manager' (4c79fc78-7c6c-4005-b9a0-f6b0347fb7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdbf852-6c95-4484-929e-8fd85c834dda]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:38 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d0fd8cd3-1667-4bec-829c-307425f0d1a7 tempest-ProjectReaderTests-1909689210 None] Created volume successfully. Jul 03 17:47:38 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a" released by "delete_volume" :: held 1.643s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:38 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be Jul 03 17:47:38 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Created reservations ['2e845a7b-2df8-4edc-996c-20c1956d5e2e', 'b991eb5a-f61a-4a01-8981-5a32e5540103', '5d3de3cc-60dd-449d-8f46-d5d2ed335497', 'e07bf0c2-e2d8-4e5a-b12e-0e9c144493cb'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:38 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:38 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Acquiring lock "cinder-b53a0697-4c54-48ce-b904-53bbd407c301-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:38 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Lock "cinder-b53a0697-4c54-48ce-b904-53bbd407c301-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Acquiring lock "cinder-quobyte-b53a0697-4c54-48ce-b904-53bbd407c301" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Lock "cinder-quobyte-b53a0697-4c54-48ce-b904-53bbd407c301" acquired by "delete_volume" :: waited 0.044s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aa3eeb-f5f8-4f60-a4e3-4fe46b4ef48b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:39 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 Jul 03 17:47:39 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:39 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" returned: 0 in 0.878s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:39 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 1G Jul 03 17:47:39 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:39 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.938s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Deleted volume successfully. Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-802048e1-c32f-4dae-bd7b-a2386820d478 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-2ed8bc14-c64b-4c85-96eb-0f9b748cd67a-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (17c31ccb-ea06-4d7b-8208-ff5bc304fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3499f398-c4f4-456a-afbc-eafba9f19ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3499f398-c4f4-456a-afbc-eafba9f19ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022349461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efec99e-d1cd-4152-93ce-781b515b244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:40Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f59b0b-6617-4d5f-baeb-7d3d9ab76afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f59b0b-6617-4d5f-baeb-7d3d9ab76afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068d73b3-f9d7-482d-9081-70b3b92c48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068d73b3-f9d7-482d-9081-70b3b92c48d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efec99e-d1cd-4152-93ce-781b515b244b', 'volume_name': 'volume-4efec99e-d1cd-4152-93ce-781b515b244b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2b2012-a282-47c4-aaf6-9bee8994017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2b2012-a282-47c4-aaf6-9bee8994017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9cd282-c55d-42d2-b779-1829b92558f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:39 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Volume 4efec99e-d1cd-4152-93ce-781b515b244b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efec99e-d1cd-4152-93ce-781b515b244b', 'volume_size': 1} Jul 03 17:47:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:40 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301" returned: 0 in 0.963s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:40 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301 Jul 03 17:47:40 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:40 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 1G" returned: 0 in 1.024s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:40 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 Jul 03 17:47:40 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:40 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-b53a0697-4c54-48ce-b904-53bbd407c301" returned: 0 in 0.700s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Lock "cinder-quobyte-b53a0697-4c54-48ce-b904-53bbd407c301" released by "delete_volume" :: held 1.729s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Created reservations ['8d96731d-ec16-49e8-b65c-a98355ffb9c1', 'ea105878-295b-4c3d-8198-61a5e8154355', '7ebdc3e0-d62f-4f36-a41e-fd5537cd9ba1', '1dafe569-8e26-4912-be96-89f0f949a113'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:40 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:40 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:41 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452" returned: 0 in 0.837s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:41 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 is being set with open permissions: ugo+rw Jul 03 17:47:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:41 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 Jul 03 17:47:41 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:41 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.815s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:41 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Deleted volume successfully. Jul 03 17:47:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-aa96a331-9729-40c5-bacd-94f246a227e3 tempest-ProjectReaderTests-1909689210 None] Lock "cinder-b53a0697-4c54-48ce-b904-53bbd407c301-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:41 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:42 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info Jul 03 17:47:42 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:42 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info" returned: 0 in 0.759s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:42 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info is being set with open permissions: ugo+rw Jul 03 17:47:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:42 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info Jul 03 17:47:42 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:43 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.info" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.038s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.614s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022349461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efec99e-d1cd-4152-93ce-781b515b244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:40Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Creating volume 4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:43 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:43 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b 1073741824 Jul 03 17:47:43 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:43 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6ae694b3-4dc5-4f91-9811-960f7a10f5c0 tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:43 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:43 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-c45a89b4-7e62-45f4-95a5-edd1a9728452-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Lock "cinder-c45a89b4-7e62-45f4-95a5-edd1a9728452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-c45a89b4-7e62-45f4-95a5-edd1a9728452" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-c45a89b4-7e62-45f4-95a5-edd1a9728452" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot c45a89b4-7e62-45f4-95a5-edd1a9728452 of volume ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dcdb09-daee-494e-ae05-d8f17bbe9b07]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:44 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 Jul 03 17:47:44 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:44 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b 1073741824" returned: 0 in 0.929s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:44 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b Jul 03 17:47:44 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:44 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.782s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:47:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:47:45 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452" returned: 0 in 0.843s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c1d02-1538-470b-84c2-6cc5de6c9ca8]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:45 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b" returned: 0 in 0.723s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9cd282-c55d-42d2-b779-1829b92558f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efec99e-d1cd-4152-93ce-781b515b244b', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b090c0f-e0f9-4f05-9ded-00a0f09e923a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:45 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Volume volume-4efec99e-d1cd-4152-93ce-781b515b244b (4efec99e-d1cd-4152-93ce-781b515b244b): created successfully Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b090c0f-e0f9-4f05-9ded-00a0f09e923a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (17c31ccb-ea06-4d7b-8208-ff5bc304fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:45 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be Jul 03 17:47:45 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ba86cd31-5f1a-4043-96eb-9bf5b3e90a76 tempest-ProjectReaderTests-1928166671 None] Created volume successfully. Jul 03 17:47:45 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" returned: 0 in 0.844s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:45 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 Jul 03 17:47:45 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Creating offline snapshot 65ccdbee-3387-4a02-a43c-4cc4470f559a of volume 4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6502c7-9d22-4be2-bf62-eb02157b182c]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:46 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b Jul 03 17:47:46 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:46 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:46 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452 Jul 03 17:47:46 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:47 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:47 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a 1G Jul 03 17:47:47 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:47 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be.c45a89b4-7e62-45f4-95a5-edd1a9728452" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-c45a89b4-7e62-45f4-95a5-edd1a9728452" released by "_delete_snapshot" :: held 3.180s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" released by "delete_snapshot" :: held 3.211s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Created reservations ['f5534e0e-c450-4747-bb62-98e75f831a82', 'bd791742-afff-4269-b1c6-9340575cae37', '21d9f301-00ca-4ffa-9b35-60a8a3c74376', 'ea8348a5-a1db-4531-922a-14310edfc9e0'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fa4103e3-4531-4f46-b151-570265040b22 tempest-ProjectMemberTests-725070442 None] Lock "cinder-c45a89b4-7e62-45f4-95a5-edd1a9728452-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:47 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a 1G" returned: 0 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efec99e-d1cd-4152-93ce-781b515b244b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:47 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efec99e-d1cd-4152-93ce-781b515b244b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a Jul 03 17:47:47 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Lock "cinder-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9027d8-9ddd-4202-8993-ec4dbd3964f3]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:48 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be Jul 03 17:47:48 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:48 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efec99e-d1cd-4152-93ce-781b515b244b -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a" returned: 0 in 0.668s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:48 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a is being set with open permissions: ugo+rw Jul 03 17:47:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:48 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a Jul 03 17:47:48 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:49 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" returned: 0 in 0.716s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:49 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be Jul 03 17:47:49 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:49 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a" returned: 0 in 0.637s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:49 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info Jul 03 17:47:49 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:49 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" returned: 0 in 0.634s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be" released by "delete_volume" :: held 1.409s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:49 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info" returned: 0 in 0.645s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:49 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info is being set with open permissions: ugo+rw Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Created reservations ['f65c30ab-17bb-4fdf-b8ca-8f789fa61b37', 'c0627fa4-0e86-4257-8d01-94c82530503f', 'b2655b48-a72c-4a28-8542-7b93c5cea5be', 'e4c9a29e-54b8-450a-a5c0-bd2f43ab6147'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:49 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info Jul 03 17:47:49 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:50 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:50 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:50 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.info" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4f570d80-3f3d-4678-a143-7e564ea3d28b tempest-ProjectReaderTests-1928166671 None] Create snapshot completed successfully Jul 03 17:47:50 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:50 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:50 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:47:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c6daabd-f8e6-4e3e-a1a5-4d5ec79bf369 tempest-ProjectMemberTests-725070442 None] Lock "cinder-ab1869eb-47aa-432b-b1ad-44e2b2b5c6be-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (59f4be9c-d20f-4de9-835e-50280485a0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74d30b6-6b17-4b02-b365-d86235921738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74d30b6-6b17-4b02-b365-d86235921738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551852879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e5e978-eb1f-4764-a46b-79334e221d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:51Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5907234b-6a7e-4d0a-87c5-a015ef8aff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5907234b-6a7e-4d0a-87c5-a015ef8aff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c60178-29aa-4df8-b27c-98f2d6764947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c60178-29aa-4df8-b27c-98f2d6764947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e5e978-eb1f-4764-a46b-79334e221d3e', 'volume_name': 'volume-19e5e978-eb1f-4764-a46b-79334e221d3e', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286d09a-935f-4b5d-92b4-62220af1c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286d09a-935f-4b5d-92b4-62220af1c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c389030-9866-42cb-9e29-dafeb7c2c251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:51 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Volume 19e5e978-eb1f-4764-a46b-79334e221d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e5e978-eb1f-4764-a46b-79334e221d3e', 'volume_size': 1} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551852879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e5e978-eb1f-4764-a46b-79334e221d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:51Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Creating volume 19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:51 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:51 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e 1073741824 Jul 03 17:47:51 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-65ccdbee-3387-4a02-a43c-4cc4470f559a-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Lock "cinder-65ccdbee-3387-4a02-a43c-4cc4470f559a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-4efec99e-d1cd-4152-93ce-781b515b244b" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4efec99e-d1cd-4152-93ce-781b515b244b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-65ccdbee-3387-4a02-a43c-4cc4470f559a" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-65ccdbee-3387-4a02-a43c-4cc4470f559a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Deleting offline snapshot 65ccdbee-3387-4a02-a43c-4cc4470f559a of volume 4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] snapshot_file for this snap is: volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070a031-4ecc-4dda-ba18-5d0e719293af]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:51 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a Jul 03 17:47:51 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:51 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e 1073741824" returned: 0 in 0.803s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:51 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e Jul 03 17:47:51 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:52 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a" returned: 0 in 0.785s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efec99e-d1cd-4152-93ce-781b515b244b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dcc260-bfee-433f-8314-bd29a43ef8dd]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:52 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b Jul 03 17:47:52 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:52 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e" returned: 0 in 0.661s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c389030-9866-42cb-9e29-dafeb7c2c251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e5e978-eb1f-4764-a46b-79334e221d3e', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c2b1ce-da78-45f8-a6b1-4c0b97d8d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:52 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Volume volume-19e5e978-eb1f-4764-a46b-79334e221d3e (19e5e978-eb1f-4764-a46b-79334e221d3e): created successfully Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c2b1ce-da78-45f8-a6b1-4c0b97d8d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:52 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (59f4be9c-d20f-4de9-835e-50280485a0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d1b4ac5a-ef32-4326-a205-e9345658800f tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:53 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 0ac7a69c-9282-4363-aa05-4ad7005c67aa of volume 19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:47:53 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a Jul 03 17:47:53 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c7fe45-13e1-41a5-8b23-18ba4307b942]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:53 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e Jul 03 17:47:53 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:54 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a" returned: 0 in 0.743s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:54 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a Jul 03 17:47:54 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:54 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:54 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa 1G Jul 03 17:47:54 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:54 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b.65ccdbee-3387-4a02-a43c-4cc4470f559a" returned: 0 in 0.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-65ccdbee-3387-4a02-a43c-4cc4470f559a" released by "_delete_snapshot" :: held 3.034s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4efec99e-d1cd-4152-93ce-781b515b244b" released by "delete_snapshot" :: held 3.061s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Created reservations ['fa2d595c-8a94-4784-aedd-d7b10ea06d5a', 'b2512c94-94ee-40ed-9366-8db7cc5c4633', 'e89a8170-211d-4385-86a0-82cd85fb8466', '9dba6f2b-6544-4bb8-b902-630188eff6f9'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:54 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Delete snapshot completed successfully. Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-42e1a9ff-aacf-4199-bf20-3d829663bbef tempest-ProjectReaderTests-1928166671 None] Lock "cinder-65ccdbee-3387-4a02-a43c-4cc4470f559a-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:54 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa 1G" returned: 0 in 0.791s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e5e978-eb1f-4764-a46b-79334e221d3e -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:54 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e5e978-eb1f-4764-a46b-79334e221d3e -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa Jul 03 17:47:54 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:55 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e5e978-eb1f-4764-a46b-79334e221d3e -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa" returned: 0 in 0.660s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:55 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa is being set with open permissions: ugo+rw Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:55 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa Jul 03 17:47:55 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-4efec99e-d1cd-4152-93ce-781b515b244b-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Lock "cinder-4efec99e-d1cd-4152-93ce-781b515b244b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-4efec99e-d1cd-4152-93ce-781b515b244b" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4efec99e-d1cd-4152-93ce-781b515b244b" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb1c904-868d-4fd5-9e5d-58ef826cb94e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:56 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b Jul 03 17:47:56 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:56 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:56 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info Jul 03 17:47:56 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:56 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b" returned: 0 in 0.737s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:56 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b Jul 03 17:47:56 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:56 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:56 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info is being set with open permissions: ugo+rw Jul 03 17:47:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:56 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info Jul 03 17:47:56 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:57 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4efec99e-d1cd-4152-93ce-781b515b244b" returned: 0 in 0.622s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4efec99e-d1cd-4152-93ce-781b515b244b" released by "delete_volume" :: held 1.416s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Created reservations ['298f0747-db56-4bb8-8470-4daff4ab7a67', '17c89256-26a1-494b-ad05-671453eecc9c', '690adb33-5377-4541-88f1-b7303f07670f', 'e8f31495-9e0f-473e-ba42-f6de5a46cf01'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:57 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:47:57 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:57 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.info" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.243s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:57 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-1a538658-6454-4c27-bd45-f16fea0b722f tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:47:58 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.642s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:47:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Deleted volume successfully. Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-4bfd6eb5-5644-4ce6-acaf-fb875047254e tempest-ProjectReaderTests-1928166671 None] Lock "cinder-4efec99e-d1cd-4152-93ce-781b515b244b-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (3726e25f-16bd-4570-9fd3-ff555ff53dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1167e773-8aee-4969-b4ae-0363ce2ba21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-0ac7a69c-9282-4363-aa05-4ad7005c67aa-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1167e773-8aee-4969-b4ae-0363ce2ba21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483175048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40705dde-6526-4cd7-95c7-a013fa725905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:58Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b71c746-cf81-41a7-84fc-e961e89df92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b71c746-cf81-41a7-84fc-e961e89df92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c713ba-c48f-472c-838a-da29a3739f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c713ba-c48f-472c-838a-da29a3739f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40705dde-6526-4cd7-95c7-a013fa725905', 'volume_name': 'volume-40705dde-6526-4cd7-95c7-a013fa725905', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1709a675-8005-497a-93bc-f8585c6ddf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1709a675-8005-497a-93bc-f8585c6ddf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a746dc75-2d18-473e-8879-b667608bb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:47:58 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Volume 40705dde-6526-4cd7-95c7-a013fa725905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40705dde-6526-4cd7-95c7-a013fa725905', 'volume_size': 1} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483175048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40705dde-6526-4cd7-95c7-a013fa725905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:47:58Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Creating volume 40705dde-6526-4cd7-95c7-a013fa725905 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:47:58 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Lock "cinder-0ac7a69c-9282-4363-aa05-4ad7005c67aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-19e5e978-eb1f-4764-a46b-79334e221d3e" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:58 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 1073741824 Jul 03 17:47:58 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-19e5e978-eb1f-4764-a46b-79334e221d3e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-0ac7a69c-9282-4363-aa05-4ad7005c67aa" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-0ac7a69c-9282-4363-aa05-4ad7005c67aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 0ac7a69c-9282-4363-aa05-4ad7005c67aa of volume 19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1772d95b-1bc2-440b-8bec-456aa2815839]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:58 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa Jul 03 17:47:58 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:59 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 1073741824" returned: 0 in 0.812s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:59 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 03 17:47:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:47:59 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19e5e978-eb1f-4764-a46b-79334e221d3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:47:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:59 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c365ccd7-32d7-4cd4-9149-8d36ec536075]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:47:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:47:59 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 Jul 03 17:47:59 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:47:59 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e Jul 03 17:47:59 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:00 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a746dc75-2d18-473e-8879-b667608bb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40705dde-6526-4cd7-95c7-a013fa725905', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c971504e-14b0-4198-9f8e-4f862328f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:00 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Volume volume-40705dde-6526-4cd7-95c7-a013fa725905 (40705dde-6526-4cd7-95c7-a013fa725905): created successfully Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c971504e-14b0-4198-9f8e-4f862328f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (3726e25f-16bd-4570-9fd3-ff555ff53dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:48:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-347f21cb-e219-44dd-9220-a469801652cc tempest-ProjectReaderTests-1928166671 None] Created volume successfully. Jul 03 17:48:00 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e" returned: 0 in 0.760s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:00 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa Jul 03 17:48:00 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Creating offline snapshot 535927ad-ec64-4ea1-ac38-5697f2301e45 of volume 40705dde-6526-4cd7-95c7-a013fa725905 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[758bc9b7-f9ff-425f-b4d3-99d363f7710f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:00 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905 Jul 03 17:48:00 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:00 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa" returned: 0 in 0.728s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:00 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa Jul 03 17:48:00 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:01 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:01 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 1G Jul 03 17:48:01 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:01 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e.0ac7a69c-9282-4363-aa05-4ad7005c67aa" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-0ac7a69c-9282-4363-aa05-4ad7005c67aa" released by "_delete_snapshot" :: held 3.020s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-19e5e978-eb1f-4764-a46b-79334e221d3e" released by "delete_snapshot" :: held 3.044s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Created reservations ['98b8b6da-741d-43da-8145-9b5eec6fa809', '2cb7ec89-2aa7-466d-8f85-dbf136264d11', '20ef505a-8783-4e7e-8c00-f446c08309dc', '2fe80c79-06a3-4ffb-982e-915e84ecd4cf'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:48:01 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:48:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e0d4d009-5c5a-4e63-8d96-af1601dc3c37 tempest-ProjectMemberTests-725070442 None] Lock "cinder-0ac7a69c-9282-4363-aa05-4ad7005c67aa-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:02 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 1G" returned: 0 in 0.788s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40705dde-6526-4cd7-95c7-a013fa725905 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:02 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40705dde-6526-4cd7-95c7-a013fa725905 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 Jul 03 17:48:02 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-19e5e978-eb1f-4764-a46b-79334e221d3e-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Lock "cinder-19e5e978-eb1f-4764-a46b-79334e221d3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-19e5e978-eb1f-4764-a46b-79334e221d3e" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-19e5e978-eb1f-4764-a46b-79334e221d3e" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5684a-21b0-4c01-a729-a9bda37e4c54]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:48:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:02 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e Jul 03 17:48:02 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:03 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40705dde-6526-4cd7-95c7-a013fa725905 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45" returned: 0 in 0.701s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:03 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 is being set with open permissions: ugo+rw Jul 03 17:48:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:03 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45 Jul 03 17:48:03 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:03 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e" returned: 0 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:03 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e Jul 03 17:48:03 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:03 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.535927ad-ec64-4ea1-ac38-5697f2301e45" returned: 0 in 0.648s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:03 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info Jul 03 17:48:03 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:04 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-19e5e978-eb1f-4764-a46b-79334e221d3e" returned: 0 in 0.656s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-19e5e978-eb1f-4764-a46b-79334e221d3e" released by "delete_volume" :: held 1.478s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=136,cinder:INSERT=48,cinder:UPDATE=166,cinder:DELETE=14 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Created reservations ['97d357d0-866a-4b33-a07f-d39289a7fb57', '293b7e16-7d7e-433b-9fb4-a006b13eb4f3', '2ba5d71f-2e07-46f7-a173-7b155e4136df', '557c6324-8f2b-4d3b-b552-7bd651e4a64b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:48:04 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info" returned: 0 in 0.674s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:04 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info is being set with open permissions: ugo+rw Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:04 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info Jul 03 17:48:04 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:04 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:48:04 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:04 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-40705dde-6526-4cd7-95c7-a013fa725905.info" returned: 0 in 0.635s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.300s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=122,cinder:INSERT=43,cinder:UPDATE=167,cinder:DELETE=12 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:48:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f9285260-321d-434f-9da6-4b496a3f07e8 tempest-ProjectReaderTests-1928166671 None] Create snapshot completed successfully Jul 03 17:48:05 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.681s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:48:05 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2c206fb1-bdfd-4aca-9c00-09ebb5782d74 tempest-ProjectMemberTests-725070442 None] Lock "cinder-19e5e978-eb1f-4764-a46b-79334e221d3e-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (c3fc65ac-8ffb-4991-93a0-b0e14c089f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef99d75e-2ee5-4db8-9a04-d31cb0f16986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef99d75e-2ee5-4db8-9a04-d31cb0f16986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-910130947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5a31a8-e70c-4ca6-86ac-9b13425414c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:48:05Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739a5cf9-54d0-431d-b71e-e186c62e0596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739a5cf9-54d0-431d-b71e-e186c62e0596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0401812-43e5-4ad9-bcbc-ec2a1ec63a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0401812-43e5-4ad9-bcbc-ec2a1ec63a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5a31a8-e70c-4ca6-86ac-9b13425414c3', 'volume_name': 'volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d42c553-d94f-4a5d-ade0-af92d36a8821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d42c553-d94f-4a5d-ade0-af92d36a8821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aeca9e6-a6ea-4dec-88ee-fc0875062b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:05 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Volume 1f5a31a8-e70c-4ca6-86ac-9b13425414c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3', 'volume_size': 1} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-910130947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5a31a8-e70c-4ca6-86ac-9b13425414c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:48:05Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Creating volume 1f5a31a8-e70c-4ca6-86ac-9b13425414c3 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:48:05 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:05 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 1073741824 Jul 03 17:48:05 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3fbc0645-0963-4df4-9914-c9db315c4793 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-535927ad-ec64-4ea1-ac38-5697f2301e45-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3fbc0645-0963-4df4-9914-c9db315c4793 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-535927ad-ec64-4ea1-ac38-5697f2301e45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:48:05 devstack cinder-volume[86621]: INFO cinder.message.api [None req-3fbc0645-0963-4df4-9914-c9db315c4793 tempest-ProjectReaderTests-1928166671 None] Creating message record for request_id = req-3fbc0645-0963-4df4-9914-c9db315c4793 Jul 03 17:48:05 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3fbc0645-0963-4df4-9914-c9db315c4793 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-535927ad-ec64-4ea1-ac38-5697f2301e45-delete_snapshot" released by "delete_snapshot" :: held 0.038s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server [None req-3fbc0645-0963-4df4-9914-c9db315c4793 tempest-ProjectReaderTests-1928166671 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 17:48:06 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server Jul 03 17:48:06 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 1073741824" returned: 0 in 0.827s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:06 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 Jul 03 17:48:06 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:06 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3" returned: 0 in 0.609s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aeca9e6-a6ea-4dec-88ee-fc0875062b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d65903-8deb-4a65-a089-a34166388e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:48:06 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Volume volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 (1f5a31a8-e70c-4ca6-86ac-9b13425414c3): created successfully Jul 03 17:48:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d65903-8deb-4a65-a089-a34166388e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:48:07 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (c3fc65ac-8ffb-4991-93a0-b0e14c089f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:48:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fa92928e-ae07-4e59-8ca7-0754d274b3d7 tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:48:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:48:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:48:07 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 9a96c638-ed20-4b47-b852-4ed56788f034 of volume 1f5a31a8-e70c-4ca6-86ac-9b13425414c3 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:48:07 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c57366-639e-4d97-aa4c-82edcb078078]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:48:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:07 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 Jul 03 17:48:07 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:08 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3" returned: 0 in 0.729s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:08 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 1G Jul 03 17:48:08 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:09 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 1G" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:09 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 Jul 03 17:48:09 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:09 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034" returned: 0 in 0.656s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:09 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 is being set with open permissions: ugo+rw Jul 03 17:48:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:09 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034 Jul 03 17:48:09 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:10 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.9a96c638-ed20-4b47-b852-4ed56788f034" returned: 0 in 0.606s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:10 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info Jul 03 17:48:10 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:11 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info" returned: 0 in 0.610s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:11 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info is being set with open permissions: ugo+rw Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:11 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info Jul 03 17:48:11 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:11 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1f5a31a8-e70c-4ca6-86ac-9b13425414c3.info" returned: 0 in 0.603s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.037s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3110f425-a82c-489e-b189-cd46ce31240c tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b0022f9-8b12-4364-9285-f72830712aa5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-9a96c638-ed20-4b47-b852-4ed56788f034-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b0022f9-8b12-4364-9285-f72830712aa5 tempest-ProjectMemberTests-725070442 None] Lock "cinder-9a96c638-ed20-4b47-b852-4ed56788f034-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:48:11 devstack cinder-volume[86621]: INFO cinder.message.api [None req-6b0022f9-8b12-4364-9285-f72830712aa5 tempest-ProjectMemberTests-725070442 None] Creating message record for request_id = req-6b0022f9-8b12-4364-9285-f72830712aa5 Jul 03 17:48:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6b0022f9-8b12-4364-9285-f72830712aa5 tempest-ProjectMemberTests-725070442 None] Lock "cinder-9a96c638-ed20-4b47-b852-4ed56788f034-delete_snapshot" released by "delete_snapshot" :: held 0.030s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server [None req-6b0022f9-8b12-4364-9285-f72830712aa5 tempest-ProjectMemberTests-725070442 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 17:48:11 devstack cinder-volume[86621]: ERROR oslo_messaging.rpc.server Jul 03 17:48:21 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=13,cinder:SELECT=10,cinder:DELETE=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:48:21 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:48:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:48:43 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:48:43 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:48:44 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 03 17:48:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.612s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:48:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:48:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:48:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:48:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:48:58 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:49:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:49:43 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:49:43 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:49:44 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 03 17:49:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.616s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:49:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:49:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:49:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:49:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:50:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:50:43 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:50:43 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:50:44 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 03 17:50:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.618s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:50:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:50:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:50:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:50:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:50:58 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:50:58 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=1 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (9c910ee2-49e6-440d-a878-e86b019dfab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb4c032-42ac-4986-b392-70e473c3cf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb4c032-42ac-4986-b392-70e473c3cf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202759958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4261f8cd-62d0-4e41-98ac-841759475c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:22Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094223c2-769f-41ce-9d01-be1078d269fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094223c2-769f-41ce-9d01-be1078d269fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dac0e87-7a72-41e8-9f88-166a1f763429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dac0e87-7a72-41e8-9f88-166a1f763429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4261f8cd-62d0-4e41-98ac-841759475c63', 'volume_name': 'volume-4261f8cd-62d0-4e41-98ac-841759475c63', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eec8aa-80c5-4bec-8f25-f8d2c928e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eec8aa-80c5-4bec-8f25-f8d2c928e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca638ea-f933-44b2-ab86-1685500fb6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:21 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Volume 4261f8cd-62d0-4e41-98ac-841759475c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4261f8cd-62d0-4e41-98ac-841759475c63', 'volume_size': 1} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202759958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4261f8cd-62d0-4e41-98ac-841759475c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:22Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Creating volume 4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:51:21 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:51:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:21 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 1073741824 Jul 03 17:51:21 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:22 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 1073741824" returned: 0 in 0.773s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:22 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 Jul 03 17:51:22 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:23 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca638ea-f933-44b2-ab86-1685500fb6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4261f8cd-62d0-4e41-98ac-841759475c63', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bde815-892d-439a-8b39-767b9866f1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:23 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Volume volume-4261f8cd-62d0-4e41-98ac-841759475c63 (4261f8cd-62d0-4e41-98ac-841759475c63): created successfully Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bde815-892d-439a-8b39-767b9866f1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (9c910ee2-49e6-440d-a878-e86b019dfab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c30bab5f-473c-413d-9961-1eebcc8cafcf tempest-ProjectReaderTests-1928166671 None] Created volume successfully. Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Creating offline snapshot 76f558d5-aa11-4d5a-b739-4f56110ba80c of volume 4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[603193a6-d40e-458e-9250-36ddd58d4580]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:23 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 Jul 03 17:51:23 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:24 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63" returned: 0 in 0.721s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:24 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c 1G Jul 03 17:51:24 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:25 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c 1G" returned: 0 in 0.762s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4261f8cd-62d0-4e41-98ac-841759475c63 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:25 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4261f8cd-62d0-4e41-98ac-841759475c63 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c Jul 03 17:51:25 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:26 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4261f8cd-62d0-4e41-98ac-841759475c63 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c" returned: 0 in 0.675s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:26 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c is being set with open permissions: ugo+rw Jul 03 17:51:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:26 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c Jul 03 17:51:26 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:26 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c" returned: 0 in 0.605s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:26 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info Jul 03 17:51:26 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:27 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info" returned: 0 in 0.614s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:27 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info is being set with open permissions: ugo+rw Jul 03 17:51:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:27 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info Jul 03 17:51:27 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:27 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.info" returned: 0 in 0.613s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.113s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b8ed7d18-78ab-4069-8c08-9f0886781f99 tempest-ProjectReaderTests-1928166671 None] Create snapshot completed successfully Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (7c897da4-6b62-45c2-a9e6-9b0a46ff1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3ce409-9b49-4417-8c6f-26caf5a37180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3ce409-9b49-4417-8c6f-26caf5a37180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371996553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff297610-9099-4146-81e8-81e548959dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:28Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9222a3de-ca07-40f1-98c1-5df236170faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9222a3de-ca07-40f1-98c1-5df236170faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d28a40-a4e5-45d3-ac88-a31b8f2db551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d28a40-a4e5-45d3-ac88-a31b8f2db551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff297610-9099-4146-81e8-81e548959dd9', 'volume_name': 'volume-ff297610-9099-4146-81e8-81e548959dd9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f5a82b-f227-4c39-b5a3-b05abc61027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f5a82b-f227-4c39-b5a3-b05abc61027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6873a98f-ce4a-427e-a9bf-7c8932fed1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:28 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Volume ff297610-9099-4146-81e8-81e548959dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff297610-9099-4146-81e8-81e548959dd9', 'volume_size': 1} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371996553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff297610-9099-4146-81e8-81e548959dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:28Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Creating volume ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:51:28 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:51:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:28 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 1073741824 Jul 03 17:51:28 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-76f558d5-aa11-4d5a-b739-4f56110ba80c-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-76f558d5-aa11-4d5a-b739-4f56110ba80c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-4261f8cd-62d0-4e41-98ac-841759475c63" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4261f8cd-62d0-4e41-98ac-841759475c63" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-76f558d5-aa11-4d5a-b739-4f56110ba80c" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-76f558d5-aa11-4d5a-b739-4f56110ba80c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Deleting offline snapshot 76f558d5-aa11-4d5a-b739-4f56110ba80c of volume 4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] snapshot_file for this snap is: volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb077c-7b14-43a6-8094-e58b690ada05]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:29 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c Jul 03 17:51:29 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:29 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 1073741824" returned: 0 in 0.794s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:29 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 Jul 03 17:51:29 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:29 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4261f8cd-62d0-4e41-98ac-841759475c63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d5c50-495e-480f-9b77-b8618ff7b784]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:30 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 Jul 03 17:51:30 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:30 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9" returned: 0 in 0.645s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6873a98f-ce4a-427e-a9bf-7c8932fed1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff297610-9099-4146-81e8-81e548959dd9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd4e69b-1eed-45b1-b211-7fc79015733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:30 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Volume volume-ff297610-9099-4146-81e8-81e548959dd9 (ff297610-9099-4146-81e8-81e548959dd9): created successfully Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd4e69b-1eed-45b1-b211-7fc79015733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (7c897da4-6b62-45c2-a9e6-9b0a46ff1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:30 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-43b00e13-cc3d-4f8f-82da-02a7b4913f1e tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:51:30 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:30 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c Jul 03 17:51:30 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 456400be-4c75-4827-9209-cbbd913aa430 of volume ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9843cf-4900-4eae-88b7-523b535aa775]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:30 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 Jul 03 17:51:30 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:31 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c" returned: 0 in 0.711s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:31 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c Jul 03 17:51:31 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:31 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9" returned: 0 in 0.735s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:31 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 1G Jul 03 17:51:31 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:32 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63.76f558d5-aa11-4d5a-b739-4f56110ba80c" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-76f558d5-aa11-4d5a-b739-4f56110ba80c" released by "_delete_snapshot" :: held 2.943s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4261f8cd-62d0-4e41-98ac-841759475c63" released by "delete_snapshot" :: held 2.964s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Created reservations ['51d527b0-8688-4a70-a5ab-6a01bcaeb8db', '2577bc21-db27-4e81-9c74-9d0659c5612d', 'd3cb8067-d11e-4fbb-ae23-0211d171a8ba', '517e6466-6fa7-4d17-b91b-86375149e3ff'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:32 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Delete snapshot completed successfully. Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-49f15183-6102-49e6-925e-7cec93e268f8 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-76f558d5-aa11-4d5a-b739-4f56110ba80c-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-4261f8cd-62d0-4e41-98ac-841759475c63-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-4261f8cd-62d0-4e41-98ac-841759475c63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-4261f8cd-62d0-4e41-98ac-841759475c63" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4261f8cd-62d0-4e41-98ac-841759475c63" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:32 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 1G" returned: 0 in 0.833s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff297610-9099-4146-81e8-81e548959dd9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a0bb1d-4619-478e-bd50-38de05397751]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:32 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff297610-9099-4146-81e8-81e548959dd9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 Jul 03 17:51:32 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:32 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 Jul 03 17:51:32 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:33 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff297610-9099-4146-81e8-81e548959dd9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430" returned: 0 in 0.649s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:33 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 is being set with open permissions: ugo+rw Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:33 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 Jul 03 17:51:33 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:33 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63" returned: 0 in 0.755s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:33 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63 Jul 03 17:51:33 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:33 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430" returned: 0 in 0.620s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:33 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info Jul 03 17:51:33 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:33 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4261f8cd-62d0-4e41-98ac-841759475c63" returned: 0 in 0.648s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-4261f8cd-62d0-4e41-98ac-841759475c63" released by "delete_volume" :: held 1.471s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Created reservations ['c0b8d92e-6f23-4561-9c9d-825bf32d7d95', '9b9cbca9-3673-4558-bb92-a8e5c6fcb93a', '1bb7742f-f774-4427-a7dc-1a446c6c76b5', 'd8a9ce5c-f729-4c73-98d4-fabdf34684c3'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:33 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:51:33 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:34 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info" returned: 0 in 0.648s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:34 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info is being set with open permissions: ugo+rw Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:34 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info Jul 03 17:51:34 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:34 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:51:34 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Deleted volume successfully. Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-3c4c805d-c5cd-4d3a-90bf-02c80a1435d3 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-4261f8cd-62d0-4e41-98ac-841759475c63-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:51:34 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (9af2dc43-18a8-47c8-a8f7-0048d15b1ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faaffb2-2e00-41b3-943b-cbf7078decd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.info" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.218s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faaffb2-2e00-41b3-943b-cbf7078decd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451114697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477cc9fd-586c-4d0e-9b79-e3e995527ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:35Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1622489d-ba14-43a3-a1e5-5cce890b6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:34 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1622489d-ba14-43a3-a1e5-5cce890b6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59007d28-1c6c-4731-afc3-d7eb07dd44df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59007d28-1c6c-4731-afc3-d7eb07dd44df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477cc9fd-586c-4d0e-9b79-e3e995527ede', 'volume_name': 'volume-477cc9fd-586c-4d0e-9b79-e3e995527ede', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5417b8-2b5e-4e42-8230-fa039786a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5417b8-2b5e-4e42-8230-fa039786a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5546ea44-5457-4170-8bd9-7e0ef55cfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:35 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Volume 477cc9fd-586c-4d0e-9b79-e3e995527ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477cc9fd-586c-4d0e-9b79-e3e995527ede', 'volume_size': 1} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451114697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477cc9fd-586c-4d0e-9b79-e3e995527ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:35Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Creating volume 477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:51:35 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:35 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede 1073741824 Jul 03 17:51:35 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:35 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e74dbb02-0edb-48bb-8bbd-9c76fcb09fb5 tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:51:35 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede 1073741824" returned: 0 in 0.786s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:35 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede Jul 03 17:51:35 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:35 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-456400be-4c75-4827-9209-cbbd913aa430-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Lock "cinder-456400be-4c75-4827-9209-cbbd913aa430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-ff297610-9099-4146-81e8-81e548959dd9" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ff297610-9099-4146-81e8-81e548959dd9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-456400be-4c75-4827-9209-cbbd913aa430" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-456400be-4c75-4827-9209-cbbd913aa430" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 456400be-4c75-4827-9209-cbbd913aa430 of volume ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e2ee5-acbc-4784-aa23-d60855abde87]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:36 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 Jul 03 17:51:36 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:36 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede" returned: 0 in 0.653s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5546ea44-5457-4170-8bd9-7e0ef55cfa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477cc9fd-586c-4d0e-9b79-e3e995527ede', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72355653-5e67-4de2-b198-66028aef7f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:36 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Volume volume-477cc9fd-586c-4d0e-9b79-e3e995527ede (477cc9fd-586c-4d0e-9b79-e3e995527ede): created successfully Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72355653-5e67-4de2-b198-66028aef7f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (9af2dc43-18a8-47c8-a8f7-0048d15b1ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c48a7f63-1425-4b88-a68a-ba2f57a4cf85 tempest-ProjectReaderTests-1928166671 None] Created volume successfully. Jul 03 17:51:36 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430" returned: 0 in 0.747s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff297610-9099-4146-81e8-81e548959dd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[310171ea-f628-4b8e-9166-f823d429d836]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:36 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 Jul 03 17:51:36 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Creating offline snapshot 552d4e87-0473-4192-940c-7296a3516acd of volume 477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3723bb92-5fc0-40a0-ae52-b6f90d6b185b]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:37 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede Jul 03 17:51:37 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:37 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9" returned: 0 in 0.776s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:37 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 Jul 03 17:51:37 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:37 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:37 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd 1G Jul 03 17:51:37 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:38 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430" returned: 0 in 0.758s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:38 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430 Jul 03 17:51:38 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:38 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd 1G" returned: 0 in 0.829s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477cc9fd-586c-4d0e-9b79-e3e995527ede -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:38 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477cc9fd-586c-4d0e-9b79-e3e995527ede -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd Jul 03 17:51:38 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:39 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9.456400be-4c75-4827-9209-cbbd913aa430" returned: 0 in 0.658s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-456400be-4c75-4827-9209-cbbd913aa430" released by "_delete_snapshot" :: held 3.024s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ff297610-9099-4146-81e8-81e548959dd9" released by "delete_snapshot" :: held 3.047s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Created reservations ['1a43792c-03d0-42ed-9e89-fe1efd4a208e', 'ecc71824-5bb3-4a20-be5e-150bc73f44c8', '89cbea5e-1c62-45d0-9094-e7ecb38f26d8', '36254a06-675a-46a0-9d19-793117e67918'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:39 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-a3ac7733-377c-45bc-9175-5c129e64da2e tempest-ProjectMemberTests-725070442 None] Lock "cinder-456400be-4c75-4827-9209-cbbd913aa430-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:39 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477cc9fd-586c-4d0e-9b79-e3e995527ede -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd" returned: 0 in 0.670s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:39 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd is being set with open permissions: ugo+rw Jul 03 17:51:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:39 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd Jul 03 17:51:39 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:40 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd" returned: 0 in 0.623s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:40 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info Jul 03 17:51:40 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-ff297610-9099-4146-81e8-81e548959dd9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Lock "cinder-ff297610-9099-4146-81e8-81e548959dd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-ff297610-9099-4146-81e8-81e548959dd9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ff297610-9099-4146-81e8-81e548959dd9" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90ac911-11b9-4ec7-a5f6-40921656b2fa]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:40 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 Jul 03 17:51:40 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:40 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info" returned: 0 in 0.669s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:40 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info is being set with open permissions: ugo+rw Jul 03 17:51:40 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:40 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info Jul 03 17:51:40 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:41 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9" returned: 0 in 0.772s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:41 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9 Jul 03 17:51:41 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:41 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.info" returned: 0 in 0.659s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2aabecc7-528d-4e25-bcfb-fa91cbbc9ebc tempest-ProjectReaderTests-1928166671 None] Create snapshot completed successfully Jul 03 17:51:41 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-ff297610-9099-4146-81e8-81e548959dd9" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-ff297610-9099-4146-81e8-81e548959dd9" released by "delete_volume" :: held 1.464s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Created reservations ['d52f8453-2f17-4b75-8ed8-810428ac4646', '982c8244-7286-41d4-beb4-8c7df4cf58e9', '36732116-95e6-4a13-8865-688aa9322071', 'ae081e51-c880-43fd-b2a6-c904caba7f8e'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:41 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:51:41 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-552d4e87-0473-4192-940c-7296a3516acd-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Lock "cinder-552d4e87-0473-4192-940c-7296a3516acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-477cc9fd-586c-4d0e-9b79-e3e995527ede" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-477cc9fd-586c-4d0e-9b79-e3e995527ede" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-552d4e87-0473-4192-940c-7296a3516acd" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-552d4e87-0473-4192-940c-7296a3516acd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Deleting offline snapshot 552d4e87-0473-4192-940c-7296a3516acd of volume 477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] snapshot_file for this snap is: volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07278e8-2b49-4e89-9ba3-f83e8f976284]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:42 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.670s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:51:42 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2594d9b3-57c5-457a-8b40-191f2868b6db tempest-ProjectMemberTests-725070442 None] Lock "cinder-ff297610-9099-4146-81e8-81e548959dd9-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:42 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd Jul 03 17:51:42 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (64312d0b-23c0-4523-9632-045710496b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0724cad-71cf-420d-8fa4-2829518ee8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0724cad-71cf-420d-8fa4-2829518ee8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817159568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3938dc4-d7fa-4349-aa87-87dbb5b855f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:43Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d13a39f-5686-421a-aca8-5252867a5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d13a39f-5686-421a-aca8-5252867a5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dfba5b-5145-4328-8390-c9c8200c1992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dfba5b-5145-4328-8390-c9c8200c1992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3938dc4-d7fa-4349-aa87-87dbb5b855f9', 'volume_name': 'volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:42 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13acc19-e044-4fe4-bcd8-87212f5a11c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13acc19-e044-4fe4-bcd8-87212f5a11c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9b796a-6992-4304-a132-e12dbfe9176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:43 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Volume c3938dc4-d7fa-4349-aa87-87dbb5b855f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9', 'volume_size': 1} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817159568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3938dc4-d7fa-4349-aa87-87dbb5b855f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:43Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Creating volume c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:51:43 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:43 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 1073741824 Jul 03 17:51:43 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:43 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd" returned: 0 in 0.766s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477cc9fd-586c-4d0e-9b79-e3e995527ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05e394-ec26-4c50-ad57-cf5e939df353]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:43 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede Jul 03 17:51:43 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:43 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:51:43 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:43 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 1073741824" returned: 0 in 0.818s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:43 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 Jul 03 17:51:43 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:44 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede" returned: 0 in 0.760s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:44 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd Jul 03 17:51:44 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:44 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.673s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:51:44 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9b796a-6992-4304-a132-e12dbfe9176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8968f2-3205-4397-bfa4-64bb4879d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:44 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Volume volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 (c3938dc4-d7fa-4349-aa87-87dbb5b855f9): created successfully Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8968f2-3205-4397-bfa4-64bb4879d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (64312d0b-23c0-4523-9632-045710496b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d6cb9590-0b76-43df-b940-eb556ee4eaa5 tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:51:44 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd" returned: 0 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:44 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd Jul 03 17:51:44 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 76f67634-5b4d-4bbc-b380-950c1e6d29ec of volume c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd188127-d0d7-4808-9bf1-a215e1734778]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:45 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 Jul 03 17:51:45 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:45 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede.552d4e87-0473-4192-940c-7296a3516acd" returned: 0 in 0.659s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-552d4e87-0473-4192-940c-7296a3516acd" released by "_delete_snapshot" :: held 3.033s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-477cc9fd-586c-4d0e-9b79-e3e995527ede" released by "delete_snapshot" :: held 3.063s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Created reservations ['085b58a3-050d-4263-a6b3-6f5e27cea2c6', 'cdd3ecdd-387b-4ff4-9d9c-a1cdd88de950', 'a7a30ed7-e536-4d31-9eca-8956c77ff961', 'b8e420a2-2ae2-44d0-8057-481832c7e9d2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:45 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Delete snapshot completed successfully. Jul 03 17:51:45 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-e3d50542-32e5-463a-89a6-61aa01f431cb tempest-ProjectReaderTests-1928166671 None] Lock "cinder-552d4e87-0473-4192-940c-7296a3516acd-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:46 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" returned: 0 in 0.764s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:46 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec 1G Jul 03 17:51:46 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-477cc9fd-586c-4d0e-9b79-e3e995527ede-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-477cc9fd-586c-4d0e-9b79-e3e995527ede-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-477cc9fd-586c-4d0e-9b79-e3e995527ede" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-477cc9fd-586c-4d0e-9b79-e3e995527ede" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec5115-7437-42d5-8aac-0a133b9615b9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:46 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec 1G" returned: 0 in 0.838s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:46 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede Jul 03 17:51:46 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:46 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec Jul 03 17:51:46 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:47 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede" returned: 0 in 0.768s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:47 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec" returned: 0 in 0.704s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:47 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec is being set with open permissions: ugo+rw Jul 03 17:51:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:47 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede Jul 03 17:51:47 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:47 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec Jul 03 17:51:47 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:48 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-477cc9fd-586c-4d0e-9b79-e3e995527ede" returned: 0 in 0.667s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:48 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-477cc9fd-586c-4d0e-9b79-e3e995527ede" released by "delete_volume" :: held 1.492s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec" returned: 0 in 0.667s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:48 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info Jul 03 17:51:48 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Created reservations ['965cc945-0206-45e9-a95f-3027852b00e2', '898b6890-2baf-4874-a6ff-f795eaf0a6a8', 'b39a3604-6cd8-49f4-be61-7b50b56c6066', '1ddad118-fb5c-444f-900e-481e58f6573b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:48 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:51:48 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:48 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info" returned: 0 in 0.665s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:48 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info is being set with open permissions: ugo+rw Jul 03 17:51:48 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:48 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info Jul 03 17:51:48 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:49 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.665s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:51:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Deleted volume successfully. Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-2e2b50e9-d185-4838-956b-e4ebaecbaf15 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-477cc9fd-586c-4d0e-9b79-e3e995527ede-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (514db656-492f-4ee0-ab45-184e9d7b011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff6c144-ff67-4c1c-afd1-72c37b176d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff6c144-ff67-4c1c-afd1-72c37b176d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639323875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd98e148-98e0-4d58-92c3-96a72c600960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:49Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94326d4c-e289-4034-b184-adafc9ee0fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94326d4c-e289-4034-b184-adafc9ee0fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793de3af-68d3-411e-bf84-d19742053c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793de3af-68d3-411e-bf84-d19742053c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd98e148-98e0-4d58-92c3-96a72c600960', 'volume_name': 'volume-fd98e148-98e0-4d58-92c3-96a72c600960', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e2cd60-34fb-4703-a84b-77869cdb5a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e2cd60-34fb-4703-a84b-77869cdb5a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f195bc03-981b-4a75-a55c-3bb13846458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:49 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Volume fd98e148-98e0-4d58-92c3-96a72c600960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd98e148-98e0-4d58-92c3-96a72c600960', 'volume_size': 1} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:49 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.info" returned: 0 in 0.651s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.371s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639323875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd98e148-98e0-4d58-92c3-96a72c600960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8bced507f04f67a71638371fb458ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:49Z,use_quota=True,user_id='7f9068e6f92645788aea6f28aeae1416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Creating volume fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:51:49 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:49 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 1073741824 Jul 03 17:51:49 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:49 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-acab0f3a-2b10-4893-8a4c-7ab4b8543e39 tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-76f67634-5b4d-4bbc-b380-950c1e6d29ec-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Lock "cinder-76f67634-5b4d-4bbc-b380-950c1e6d29ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-76f67634-5b4d-4bbc-b380-950c1e6d29ec" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-76f67634-5b4d-4bbc-b380-950c1e6d29ec" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 76f67634-5b4d-4bbc-b380-950c1e6d29ec of volume c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8324b57-5894-4e51-8fe2-e4567d1c9388]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:49 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec Jul 03 17:51:49 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:50 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 1073741824" returned: 0 in 0.843s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:50 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 Jul 03 17:51:50 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:50 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec" returned: 0 in 0.768s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:51:50 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a3b356-09c7-4d9e-8f44-d91efae67e00]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:50 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 Jul 03 17:51:50 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:51 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960" returned: 0 in 0.672s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f195bc03-981b-4a75-a55c-3bb13846458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd98e148-98e0-4d58-92c3-96a72c600960', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5734d05a-e6ad-4c4f-978f-fb1dd3486a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:51 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Volume volume-fd98e148-98e0-4d58-92c3-96a72c600960 (fd98e148-98e0-4d58-92c3-96a72c600960): created successfully Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5734d05a-e6ad-4c4f-978f-fb1dd3486a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Flow 'volume_create_manager' (514db656-492f-4ee0-ab45-184e9d7b011b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-91fc094a-396c-4ced-af42-f2fc2183b3a9 tempest-ProjectReaderTests-1928166671 None] Created volume successfully. Jul 03 17:51:51 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" returned: 0 in 0.748s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:51 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec Jul 03 17:51:51 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Creating offline snapshot 2b0862db-0b0d-42b4-b8ca-4b4f0424a343 of volume fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843f452-927a-4aaf-a318-feeee28f5940]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:51 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 Jul 03 17:51:51 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:52 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec" returned: 0 in 0.756s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:52 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec Jul 03 17:51:52 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:52 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960" returned: 0 in 0.810s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:52 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 1G Jul 03 17:51:52 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:52 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9.76f67634-5b4d-4bbc-b380-950c1e6d29ec" returned: 0 in 0.661s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-76f67634-5b4d-4bbc-b380-950c1e6d29ec" released by "_delete_snapshot" :: held 3.033s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" released by "delete_snapshot" :: held 3.055s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Created reservations ['16248d48-cad0-4ec2-8690-39f29994e91d', '59951434-6e24-4437-9ea0-607365ff95eb', 'b727242a-526a-417e-ab56-d67a7802a0a9', '0ced0aad-6ca0-451e-8479-37fbb62ffef2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:52 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:51:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-7b5cc1a3-0792-4450-b5d7-f4848092cd2a tempest-ProjectMemberTests-725070442 None] Lock "cinder-76f67634-5b4d-4bbc-b380-950c1e6d29ec-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:53 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 1G" returned: 0 in 0.802s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd98e148-98e0-4d58-92c3-96a72c600960 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:53 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd98e148-98e0-4d58-92c3-96a72c600960 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 Jul 03 17:51:53 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:53 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd98e148-98e0-4d58-92c3-96a72c600960 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343" returned: 0 in 0.670s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:53 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 is being set with open permissions: ugo+rw Jul 03 17:51:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:53 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 Jul 03 17:51:53 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-c3938dc4-d7fa-4349-aa87-87dbb5b855f9-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Lock "cinder-c3938dc4-d7fa-4349-aa87-87dbb5b855f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c0b12-8d79-4db5-980b-80b3df0e1aee]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:54 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 Jul 03 17:51:54 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:54 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343" returned: 0 in 0.663s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:54 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info Jul 03 17:51:54 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:54 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" returned: 0 in 0.808s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:54 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:54 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9 Jul 03 17:51:54 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:55 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info" returned: 0 in 0.680s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:55 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info is being set with open permissions: ugo+rw Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:55 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info Jul 03 17:51:55 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:55 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" returned: 0 in 0.657s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-c3938dc4-d7fa-4349-aa87-87dbb5b855f9" released by "delete_volume" :: held 1.521s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Created reservations ['48a0fe7c-e965-4908-a353-49d66468a3be', '43991956-7129-4687-a2a8-8c2dd1bf7afd', 'b2738291-9bfd-4eb4-a1fd-d3f57dede0f6', 'a05a01e9-4377-4d87-8d29-9c80a679d7a8'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:55 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:51:55 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:55 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.info" returned: 0 in 0.638s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:55 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:55 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-75a780ee-baad-497d-ab56-da4620cb5d05 tempest-ProjectReaderTests-1928166671 None] Create snapshot completed successfully Jul 03 17:51:56 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:51:56 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-da54938a-6304-48bb-ad5b-98b93a7efcfb tempest-ProjectMemberTests-725070442 None] Lock "cinder-c3938dc4-d7fa-4349-aa87-87dbb5b855f9-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (21c940a3-0742-4621-977d-040daada3c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f096894-3d92-477d-bb81-a90851fe1caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f096894-3d92-477d-bb81-a90851fe1caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781812177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c17fd2-eadc-492f-92f2-1d66a9ab7e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:57Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ef6931-ed46-47f5-acc7-99239e86a65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ef6931-ed46-47f5-acc7-99239e86a65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49af274-b4e0-4dff-b4e5-8adb7969abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49af274-b4e0-4dff-b4e5-8adb7969abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c17fd2-eadc-492f-92f2-1d66a9ab7e1d', 'volume_name': 'volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f27e12-bb91-4884-9e72-3040fb1f6923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f27e12-bb91-4884-9e72-3040fb1f6923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77994bf8-c419-44d9-b6dd-9855d8f858fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:56 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Volume 45c17fd2-eadc-492f-92f2-1d66a9ab7e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d', 'volume_size': 1} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781812177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c17fd2-eadc-492f-92f2-1d66a9ab7e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:51:57Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Creating volume 45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:51:56 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:56 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d 1073741824 Jul 03 17:51:56 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-2b0862db-0b0d-42b4-b8ca-4b4f0424a343-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Lock "cinder-2b0862db-0b0d-42b4-b8ca-4b4f0424a343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-fd98e148-98e0-4d58-92c3-96a72c600960" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-fd98e148-98e0-4d58-92c3-96a72c600960" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-2b0862db-0b0d-42b4-b8ca-4b4f0424a343" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-2b0862db-0b0d-42b4-b8ca-4b4f0424a343" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Deleting offline snapshot 2b0862db-0b0d-42b4-b8ca-4b4f0424a343 of volume fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] snapshot_file for this snap is: volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ce626-0225-441f-8c15-7e72a07841ac]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:56 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:57 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 Jul 03 17:51:57 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:57 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d 1073741824" returned: 0 in 0.817s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:57 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d Jul 03 17:51:57 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:57 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343" returned: 0 in 0.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:57 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd98e148-98e0-4d58-92c3-96a72c600960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:51:57 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f62652-ae4e-488c-825c-034b65758808]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:57 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:57 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 Jul 03 17:51:57 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:58 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" returned: 0 in 0.650s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77994bf8-c419-44d9-b6dd-9855d8f858fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9aba633-dde6-4414-853c-1b74d74015e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:51:58 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Volume volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d (45c17fd2-eadc-492f-92f2-1d66a9ab7e1d): created successfully Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9aba633-dde6-4414-853c-1b74d74015e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (21c940a3-0742-4621-977d-040daada3c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:51:58 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f8bd2f65-04e9-4314-ab0a-af7b1617606b tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:51:58 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960" returned: 0 in 0.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:58 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 Jul 03 17:51:58 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 2a4660d3-8bbb-4036-8879-4ff023411fdc of volume 45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34089e-2fa6-4101-bea3-c6eb3abb82e2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:51:58 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:59 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d Jul 03 17:51:59 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:59 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343" returned: 0 in 0.726s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:59 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343 Jul 03 17:51:59 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:59 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" returned: 0 in 0.749s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:51:59 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc 1G Jul 03 17:51:59 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:51:59 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960.2b0862db-0b0d-42b4-b8ca-4b4f0424a343" returned: 0 in 0.629s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-2b0862db-0b0d-42b4-b8ca-4b4f0424a343" released by "_delete_snapshot" :: held 3.010s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-fd98e148-98e0-4d58-92c3-96a72c600960" released by "delete_snapshot" :: held 3.036s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:51:59 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Created reservations ['17d60d9c-6847-47e0-b4e0-1dae6a820d15', '5d8950dd-071a-4ba4-bd73-f276b89e6b91', '99fdfa1f-927a-4671-9cad-e8232e7a345b', '0f3437b0-8619-4a57-be69-87a1ad02e251'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:00 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Delete snapshot completed successfully. Jul 03 17:52:00 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-0a9e04e1-80ad-4fc0-99c6-cb71a0fb85bf tempest-ProjectReaderTests-1928166671 None] Lock "cinder-2b0862db-0b0d-42b4-b8ca-4b4f0424a343-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:00 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc 1G" returned: 0 in 0.798s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:00 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:00 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc Jul 03 17:52:00 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-fd98e148-98e0-4d58-92c3-96a72c600960-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-fd98e148-98e0-4d58-92c3-96a72c600960-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "cinder-quobyte-fd98e148-98e0-4d58-92c3-96a72c600960" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-fd98e148-98e0-4d58-92c3-96a72c600960" acquired by "delete_volume" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[734caeae-0cb1-4497-a6e1-c8f1f39d7da2]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:01 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc" returned: 0 in 0.718s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:01 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc is being set with open permissions: ugo+rw Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:01 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc Jul 03 17:52:01 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:01 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 Jul 03 17:52:01 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:01 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:01 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info Jul 03 17:52:01 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:01 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960" returned: 0 in 0.752s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:01 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:01 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960 Jul 03 17:52:01 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:02 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info" returned: 0 in 0.663s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:02 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info is being set with open permissions: ugo+rw Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:02 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info Jul 03 17:52:02 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:02 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-fd98e148-98e0-4d58-92c3-96a72c600960" returned: 0 in 0.671s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-quobyte-fd98e148-98e0-4d58-92c3-96a72c600960" released by "delete_volume" :: held 1.487s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Created reservations ['69ee0882-56d2-4490-9fbb-cb31b8fe20be', 'f7d6aa85-da9b-4448-ba4f-b2ccf16f7a1d', 'b1713309-c822-4029-bf50-02f35aed9ee9', '8828699f-2af1-410d-97ce-18b15fd9a2ed'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:02 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:02 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:02 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:03 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.info" returned: 0 in 0.659s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.295s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-864d25ae-def3-42cd-a181-fe02d98ea91f tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:52:03 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:03 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.690s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:03 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:03 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Deleted volume successfully. Jul 03 17:52:03 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b6e7a52e-4fe3-4004-9e14-e23926cab138 tempest-ProjectReaderTests-1928166671 None] Lock "cinder-fd98e148-98e0-4d58-92c3-96a72c600960-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-2a4660d3-8bbb-4036-8879-4ff023411fdc-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Lock "cinder-2a4660d3-8bbb-4036-8879-4ff023411fdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-2a4660d3-8bbb-4036-8879-4ff023411fdc" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-2a4660d3-8bbb-4036-8879-4ff023411fdc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 2a4660d3-8bbb-4036-8879-4ff023411fdc of volume 45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0d6aba-4f59-459e-802e-d44ded0e3a63]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:04 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc Jul 03 17:52:04 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:05 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:05 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:52:05 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ceb0f2-fa7d-45d4-9328-e757a7337679]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:05 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d Jul 03 17:52:05 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:06 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" returned: 0 in 0.766s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:06 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc Jul 03 17:52:06 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:06 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc" returned: 0 in 0.778s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:06 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc Jul 03 17:52:06 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:07 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d.2a4660d3-8bbb-4036-8879-4ff023411fdc" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-2a4660d3-8bbb-4036-8879-4ff023411fdc" released by "_delete_snapshot" :: held 3.121s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" released by "delete_snapshot" :: held 3.145s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:07 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Created reservations ['4612c28f-452a-43d5-8366-439f487486f6', 'd4d9faef-ffe0-4a5b-887f-b9e8e5066cc9', '2e543878-6e81-4983-bc58-eb7a2447b9df', '0ff43b95-b31e-40bc-89ee-53ec24a4f120'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:07 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:52:07 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-374cd5e2-583a-4b7a-b64c-3af91cdeca64 tempest-ProjectMemberTests-725070442 None] Lock "cinder-2a4660d3-8bbb-4036-8879-4ff023411fdc-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Lock "cinder-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:08 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad096aa4-b8b2-41ce-9f9d-ea1594ee7a8e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:08 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d Jul 03 17:52:08 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:09 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" returned: 0 in 0.813s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:09 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d Jul 03 17:52:09 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:10 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" returned: 0 in 0.659s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d" released by "delete_volume" :: held 1.541s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Created reservations ['27ec8535-42a2-4a80-9a59-db133ec2ae02', '8ad4a426-3ed1-465d-a1a7-e802a20ed760', 'b0825555-9999-4ce3-b8d6-61f48cf19a64', '945137c1-8dc0-4ecc-871f-4fa18dcfbb5d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:10 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:10 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:11 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.666s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:11 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-39312751-5f98-4369-a49b-f1a111496bf5 tempest-ProjectMemberTests-725070442 None] Lock "cinder-45c17fd2-eadc-492f-92f2-1d66a9ab7e1d-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (92a91e9e-b011-4fab-8b53-74fbbeaf7e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3349c59-c5f9-4dfe-82f1-8d416d179bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3349c59-c5f9-4dfe-82f1-8d416d179bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033648409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692d71a3-0521-447f-9b6d-99b34c7f4d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:11Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3655fd-33d8-4854-8b0f-4b6d0b9baa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3655fd-33d8-4854-8b0f-4b6d0b9baa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45471eb2-2278-4e5d-995e-12feb3541913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45471eb2-2278-4e5d-995e-12feb3541913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692d71a3-0521-447f-9b6d-99b34c7f4d3c', 'volume_name': 'volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4d3d67-6701-4015-8208-7d7515993c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4d3d67-6701-4015-8208-7d7515993c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50443bb0-84cf-49d0-8c7d-b4ae86a75382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:11 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Volume 692d71a3-0521-447f-9b6d-99b34c7f4d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c', 'volume_size': 1} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033648409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692d71a3-0521-447f-9b6d-99b34c7f4d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:11Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Creating volume 692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:52:11 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:52:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:11 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c 1073741824 Jul 03 17:52:11 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:12 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c 1073741824" returned: 0 in 0.981s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:12 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c Jul 03 17:52:12 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:13 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c" returned: 0 in 0.652s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50443bb0-84cf-49d0-8c7d-b4ae86a75382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b3f285-d723-48ad-9ee6-8f62381a4bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:13 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Volume volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c (692d71a3-0521-447f-9b6d-99b34c7f4d3c): created successfully Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b3f285-d723-48ad-9ee6-8f62381a4bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (92a91e9e-b011-4fab-8b53-74fbbeaf7e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3da9d9a0-8106-4689-ac2e-458340ef38da tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Creating offline snapshot 3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 of volume 692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f5c4b-94fb-44a6-9310-bb0555ed387a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:13 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c Jul 03 17:52:13 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:14 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c" returned: 0 in 0.801s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:14 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 1G Jul 03 17:52:14 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:15 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 1G" returned: 0 in 0.814s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:15 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 Jul 03 17:52:15 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:16 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" returned: 0 in 0.738s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:16 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 is being set with open permissions: ugo+rw Jul 03 17:52:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:16 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 Jul 03 17:52:16 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:16 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:16 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info Jul 03 17:52:16 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:17 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info" returned: 0 in 0.637s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:17 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info is being set with open permissions: ugo+rw Jul 03 17:52:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:17 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info Jul 03 17:52:17 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:18 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.info" returned: 0 in 0.662s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.410s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b413793b-14a5-4cae-880e-326e88137c9d tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-3c927ded-a0b6-4d04-ac22-8c3cd32bfb59-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Lock "cinder-3c927ded-a0b6-4d04-ac22-8c3cd32bfb59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-692d71a3-0521-447f-9b6d-99b34c7f4d3c" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-692d71a3-0521-447f-9b6d-99b34c7f4d3c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot 3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 of volume 692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee59663-b795-4749-97fd-892e939d7517]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:19 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 Jul 03 17:52:19 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:19 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" returned: 0 in 0.750s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ebe2b-902c-47c3-8ae1-673d8f84a49e]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:20 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c Jul 03 17:52:20 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:20 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c" returned: 0 in 0.806s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:20 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 Jul 03 17:52:20 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:21 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:21 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59 Jul 03 17:52:21 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:22 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c.3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-3c927ded-a0b6-4d04-ac22-8c3cd32bfb59" released by "_delete_snapshot" :: held 3.089s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-692d71a3-0521-447f-9b6d-99b34c7f4d3c" released by "delete_snapshot" :: held 3.116s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=84,cinder:UPDATE=121,cinder:INSERT=36,cinder:DELETE=10 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=95,cinder:UPDATE=104,cinder:INSERT=26,cinder:DELETE=10 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Created reservations ['9a85a9ef-ae50-44be-9093-6d57afaf8e17', 'b813d270-8ba1-4c01-8e77-b371b1405934', '6f5e0b7f-52da-4be0-b499-b4ed086270d2', '50541d68-af9b-4ab2-85b1-ca444c14e57d'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:22 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:52:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-92ebafbb-14b4-4309-9f67-7718237ba25b tempest-ProjectMemberTests-725070442 None] Lock "cinder-3c927ded-a0b6-4d04-ac22-8c3cd32bfb59-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-692d71a3-0521-447f-9b6d-99b34c7f4d3c-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-692d71a3-0521-447f-9b6d-99b34c7f4d3c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-692d71a3-0521-447f-9b6d-99b34c7f4d3c" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-692d71a3-0521-447f-9b6d-99b34c7f4d3c" acquired by "delete_volume" :: waited 0.026s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:23 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71e61a-332f-47a7-8f89-37d9239cb333]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:23 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c Jul 03 17:52:23 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:24 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c" returned: 0 in 0.819s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:24 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c Jul 03 17:52:24 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Flow 'volume_create_manager' (462a5c27-dc6a-4350-bb68-8d1d0ae369e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82050474-43bd-4375-93a3-c9b9111aa28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82050474-43bd-4375-93a3-c9b9111aa28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-677492211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035f7521760047bfafc6995116e0bcdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:25Z,use_quota=True,user_id='c72c9d5de7214d2da1d5a9529e2747aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158a4245-7648-4e31-bec0-b9a217b30881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158a4245-7648-4e31-bec0-b9a217b30881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740d67d2-68ea-496e-9a73-362625c85be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740d67d2-68ea-496e-9a73-362625c85be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1', 'volume_name': 'volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e505b6af-912b-4e28-a1a8-a05f3c1c2d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e505b6af-912b-4e28-a1a8-a05f3c1c2d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48acae91-c7c4-4980-a8c8-3f77d3a17f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:24 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Volume 47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1', 'volume_size': 1} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-677492211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035f7521760047bfafc6995116e0bcdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:25Z,use_quota=True,user_id='c72c9d5de7214d2da1d5a9529e2747aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Creating volume 47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:52:24 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:24 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 1073741824 Jul 03 17:52:24 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:24 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-692d71a3-0521-447f-9b6d-99b34c7f4d3c" returned: 0 in 0.673s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-692d71a3-0521-447f-9b6d-99b34c7f4d3c" released by "delete_volume" :: held 1.557s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:24 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Created reservations ['06932e0b-8d8a-44ee-ac5b-eba8133c0a7f', '1d61a73f-f4fd-45c9-af1d-752525b84654', 'b3129353-771c-4009-985f-17ead3744218', '3c5ce1cd-92b6-499a-8263-36c167f4a448'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:25 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:25 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:25 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 1073741824" returned: 0 in 0.860s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:25 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:25 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:25 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.751s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:25 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:52:25 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-25474acf-f5a4-4ee9-8fec-dde6a2b270f9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-692d71a3-0521-447f-9b6d-99b34c7f4d3c-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (797f4734-73f4-4a11-a01a-824a44403ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab036b3-c8a6-4349-9645-acda41604861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab036b3-c8a6-4349-9645-acda41604861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204338446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0bcc99-5698-4e2a-9c86-43c6d2b80d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:26Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dda288-a3f4-4ea0-ac73-678796438f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dda288-a3f4-4ea0-ac73-678796438f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515e2047-8d05-432d-8112-4e65ef4ba43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515e2047-8d05-432d-8112-4e65ef4ba43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0bcc99-5698-4e2a-9c86-43c6d2b80d38', 'volume_name': 'volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c42ff6-7d74-4768-a2df-7e1326c0e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c42ff6-7d74-4768-a2df-7e1326c0e388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b2f0c4-90f3-4a2f-b39d-e1d7dd31a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Volume 4f0bcc99-5698-4e2a-9c86-43c6d2b80d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38', 'volume_size': 1} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:26 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.684s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.186s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204338446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0bcc99-5698-4e2a-9c86-43c6d2b80d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72451f9dae64d27bd7b2ccdb3b58f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:26Z,use_quota=True,user_id='1d5063dffb514594876d2fb39f741d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Creating volume 4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:52:26 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48acae91-c7c4-4980-a8c8-3f77d3a17f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:26 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 1073741824 Jul 03 17:52:26 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2d18c8-0482-468c-9dec-010cc3c94d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:26 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Volume volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 (47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1): created successfully Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2d18c8-0482-468c-9dec-010cc3c94d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Flow 'volume_create_manager' (462a5c27-dc6a-4350-bb68-8d1d0ae369e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:26 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-2cf2ea48-949d-468d-893f-545510c7e015 tempest-SnapshotDependencyTests-280841541 None] Created volume successfully. Jul 03 17:52:26 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:27 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 1073741824" returned: 0 in 0.830s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:27 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 Jul 03 17:52:27 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:27 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.846s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Creating offline snapshot 36a65afe-da16-4f36-b529-77d866662c64 of volume 47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b2f0c4-90f3-4a2f-b39d-e1d7dd31a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f6094c-40b0-42d5-8d63-cc8e9e365b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[34288ac8-f0bc-49f5-b14f-ea13241ef215]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:27 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Volume volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 (4f0bcc99-5698-4e2a-9c86-43c6d2b80d38): created successfully Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f6094c-40b0-42d5-8d63-cc8e9e365b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:27 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Flow 'volume_create_manager' (797f4734-73f4-4a11-a01a-824a44403ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:27 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-d12ebb2d-0a7a-464a-85eb-dfe2ccfd75ab tempest-ProjectMemberTests-725070442 None] Created volume successfully. Jul 03 17:52:27 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:27 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:28 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:28 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 1G Jul 03 17:52:28 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:29 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 1G" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:29 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:29 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 Jul 03 17:52:29 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:30 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64" returned: 0 in 0.665s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:30 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 is being set with open permissions: ugo+rw Jul 03 17:52:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:30 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 Jul 03 17:52:30 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:30 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64" returned: 0 in 0.609s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:30 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:30 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info Jul 03 17:52:30 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:31 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info" returned: 0 in 0.613s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:31 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info is being set with open permissions: ugo+rw Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:31 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info Jul 03 17:52:31 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:31 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.info" returned: 0 in 0.607s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.136s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.632s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Creating offline snapshot a206f90d-5164-4adc-9997-73d0e91ced4c of volume 4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 17:52:31 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-05e60ef0-d32c-4027-8b21-baea0512a414 tempest-SnapshotDependencyTests-280841541 None] Create snapshot completed successfully Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f9f85-d24d-48c7-bf92-16e7b5730201]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:32 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 Jul 03 17:52:32 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Flow 'volume_create_manager' (3b8849d6-715b-4a44-a680-40bb1ce070f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc668d94-8e02-4fb5-9489-57b52f10a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:32 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" returned: 0 in 0.763s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c 1G {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc668d94-8e02-4fb5-9489-57b52f10a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714dd018-9e05-43e0-88e5-d1371e008cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035f7521760047bfafc6995116e0bcdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36a65afe-da16-4f36-b529-77d866662c64,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:52:33Z,use_quota=True,user_id='c72c9d5de7214d2da1d5a9529e2747aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:32 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c 1G Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c289712-e33d-4300-a4cd-e53ebab90555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:32 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c289712-e33d-4300-a4cd-e53ebab90555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bf31a6-c220-469c-bc7b-1ca59861eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bf31a6-c220-469c-bc7b-1ca59861eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '714dd018-9e05-43e0-88e5-d1371e008cfa', 'volume_name': 'volume-714dd018-9e05-43e0-88e5-d1371e008cfa', 'volume_size': 1, 'snapshot_id': '36a65afe-da16-4f36-b529-77d866662c64'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71c019a-a224-4063-bbd6-5d44dae59c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71c019a-a224-4063-bbd6-5d44dae59c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a651aee8-437f-4837-966f-6e4392761071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:32 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Volume 714dd018-9e05-43e0-88e5-d1371e008cfa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-714dd018-9e05-43e0-88e5-d1371e008cfa', 'volume_size': 1, 'snapshot_id': '36a65afe-da16-4f36-b529-77d866662c64'} Jul 03 17:52:32 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:33 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c 1G" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:33 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:33 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c Jul 03 17:52:33 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:34 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 -F qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c" returned: 0 in 0.655s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:34 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c is being set with open permissions: ugo+rw Jul 03 17:52:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:34 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c Jul 03 17:52:34 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:34 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c" returned: 0 in 0.625s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:34 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:34 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info Jul 03 17:52:34 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:35 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info" returned: 0 in 0.617s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:35 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info is being set with open permissions: ugo+rw Jul 03 17:52:35 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:35 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info Jul 03 17:52:35 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:36 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.info" returned: 0 in 0.637s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.164s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.299s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-quobyte-36a65afe-da16-4f36-b529-77d866662c64-714dd018-9e05-43e0-88e5-d1371e008cfa" by "_create_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-36a65afe-da16-4f36-b529-77d866662c64-714dd018-9e05-43e0-88e5-d1371e008cfa" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Creating volume 714dd018-9e05-43e0-88e5-d1371e008cfa from snapshot 36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-quobyte-714dd018-9e05-43e0-88e5-d1371e008cfa" by "_copy_volume_from_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:36 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b24b3215-c94b-4ae8-ad7a-44ba97e53cd4 tempest-ProjectMemberTests-725070442 None] Create snapshot completed successfully Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-714dd018-9e05-43e0-88e5-d1371e008cfa" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] snapshot: 36a65afe-da16-4f36-b529-77d866662c64, volume: 714dd018-9e05-43e0-88e5-d1371e008cfa, {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a6cb1-1221-451f-a259-fe75d8d2734a]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:36 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 Jul 03 17:52:36 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-a206f90d-5164-4adc-9997-73d0e91ced4c-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Lock "cinder-a206f90d-5164-4adc-9997-73d0e91ced4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-a206f90d-5164-4adc-9997-73d0e91ced4c" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-a206f90d-5164-4adc-9997-73d0e91ced4c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Deleting offline snapshot a206f90d-5164-4adc-9997-73d0e91ced4c of volume 4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] snapshot_file for this snap is: volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c10f26-548f-4116-a069-825613ee6994]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:36 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c Jul 03 17:52:36 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:36 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64" returned: 0 in 0.774s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Creating direct copy from snapshot {{(pid=86621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62c137-d63c-4457-b481-dd087ed359e9]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:36 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:37 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:37 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:37 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c" returned: 0 in 0.745s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5757f-bb1f-4f84-abd8-5e3aa0ef255d]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:37 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 Jul 03 17:52:37 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:37 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG cinder.utils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Path /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa not found in is_blk_device check {{(pid=86621) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 17:52:37 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:37 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa Jul 03 17:52:37 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:38 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" returned: 0 in 0.746s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:38 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:38 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c Jul 03 17:52:38 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:39 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c" returned: 0 in 1.296s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:39 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:39 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c Jul 03 17:52:39 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:41 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:41 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38.a206f90d-5164-4adc-9997-73d0e91ced4c" returned: 0 in 1.366s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-a206f90d-5164-4adc-9997-73d0e91ced4c" released by "_delete_snapshot" :: held 4.299s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" released by "delete_snapshot" :: held 4.341s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:41 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Created reservations ['1ac54a71-1605-4973-9bfb-0eb0606543ab', 'd39ba136-77cc-47c6-b895-655f71f8d2dc', '1bb4e6b7-d5bc-4b78-8889-213c30d2f98f', '13f6088f-2fcc-440d-b7fd-4c8d170f25d4'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:41 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Delete snapshot completed successfully. Jul 03 17:52:41 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-21ee4dfd-4d36-496b-a715-7e09ef114f2d tempest-ProjectMemberTests-725070442 None] Lock "cinder-a206f90d-5164-4adc-9997-73d0e91ced4c-delete_snapshot" released by "delete_snapshot" :: held 4.633s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Acquiring lock "cinder-quobyte-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0abc2de-41ea-4b55-9fcc-fec6e161e731]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:42 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa" returned: 0 in 4.691s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9d84a-10cf-4524-92e7-f7ebbb1a7dee]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:42 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:42 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 Jul 03 17:52:42 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:42 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:42 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:43 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" returned: 0 in 0.736s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:43 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38 Jul 03 17:52:43 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:43 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.918s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Image conversion details: src /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa {{(pid=86621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 17:52:43 devstack cinder-volume[86621]: INFO cinder.image.image_utils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Converted 1024.00 MB image at 218.21 MB/s Jul 03 17:52:43 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.remotefs [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa is being set with open permissions: ugo+rw Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:43 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa Jul 03 17:52:43 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:43 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" returned: 0 in 0.647s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:43 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:43 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-quobyte-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38" released by "delete_volume" :: held 1.456s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Created reservations ['5749ec04-421b-4ddf-997b-23d72f80be27', '4f52c286-1883-415f-a129-1fdc6a03d2a8', '32297cf7-3d5a-4c65-9de7-3fac840fa498', 'b8a43ea0-5ba5-4bba-93e8-b279c91a3a74'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:43 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:43 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:43 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:44 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa" returned: 0 in 0.656s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-714dd018-9e05-43e0-88e5-d1371e008cfa" released by "_copy_volume_from_snapshot" :: held 7.881s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-36a65afe-da16-4f36-b529-77d866662c64-714dd018-9e05-43e0-88e5-d1371e008cfa" released by "_create_volume_from_snapshot" :: held 7.910s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.935s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a651aee8-437f-4837-966f-6e4392761071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714dd018-9e05-43e0-88e5-d1371e008cfa', 'volume_size': 1, 'snapshot_id': '36a65afe-da16-4f36-b529-77d866662c64'}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343ebf9d-30e5-4e35-84c4-fcba93d0745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:52:44 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Volume volume-714dd018-9e05-43e0-88e5-d1371e008cfa (714dd018-9e05-43e0-88e5-d1371e008cfa): created successfully Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343ebf9d-30e5-4e35-84c4-fcba93d0745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Flow 'volume_create_manager' (3b8849d6-715b-4a44-a680-40bb1ce070f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:52:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c93d0701-2796-47e6-b23a-94bfb7c36dc3 tempest-SnapshotDependencyTests-280841541 None] Created volume successfully. Jul 03 17:52:44 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.612s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo_service.periodic_task [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] Running periodic task VolumeManager._thread_info {{(pid=86621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread count: 29 {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-a8a8ec15-480e-4d20-8a3f-231aa7300134 None None] thread info: [<_MainThread(MainThread, started 133693195350144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 17:52:44 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.658s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:44 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Deleted volume successfully. Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-17d67f12-1957-45a9-aa5f-c632a288e8d9 tempest-ProjectMemberTests-725070442 None] Lock "cinder-4f0bcc99-5698-4e2a-9c86-43c6d2b80d38-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-36a65afe-da16-4f36-b529-77d866662c64-delete_snapshot" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-36a65afe-da16-4f36-b529-77d866662c64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-quobyte-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" by "delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-quobyte-36a65afe-da16-4f36-b529-77d866662c64" by "_delete_snapshot" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-36a65afe-da16-4f36-b529-77d866662c64" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Deleting offline snapshot 36a65afe-da16-4f36-b529-77d866662c64 of volume 47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] snapshot_file for this snap is: volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[53500d3a-3982-4b3d-b70d-887b20fe1f6f]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:44 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:44 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 Jul 03 17:52:44 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:45 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64" returned: 0 in 0.777s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:45 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 17:52:45 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[58145bf0-dcc1-4818-bf98-4824554e2d55]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:45 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:45 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:45 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:46 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.771s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:46 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:46 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 Jul 03 17:52:46 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:47 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64" returned: 0 in 0.759s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:47 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64 Jul 03 17:52:47 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:47 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1.36a65afe-da16-4f36-b529-77d866662c64" returned: 0 in 0.646s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-36a65afe-da16-4f36-b529-77d866662c64" released by "_delete_snapshot" :: held 3.062s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" released by "delete_snapshot" :: held 3.088s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Created reservations ['f976e6ee-08b3-49bd-be93-33fc24669247', '4e1fb5a4-0b9c-45b4-ba04-e76705ef0e09', 'df3e97de-d959-4c81-894c-790e1906f336', '12247c96-93b4-4e64-9d8b-e4d0189a3ae2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:47 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Delete snapshot completed successfully. Jul 03 17:52:47 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-fc6d6e74-b2a2-48f7-9407-ba48d332c478 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-36a65afe-da16-4f36-b529-77d866662c64-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:48 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-quobyte-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:49 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" acquired by "delete_volume" :: waited 0.015s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:49 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc860166-b1ba-4c50-b5da-37dd2ac26485]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:49 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:49 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:49 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.768s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:49 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:49 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1 Jul 03 17:52:49 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:50 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" returned: 0 in 0.630s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1" released by "delete_volume" :: held 1.451s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Created reservations ['6fe86682-a5bf-4817-99cb-74bd454dac77', 'afe481a9-ccd9-4f3c-abd9-2ae15639724c', 'eb2c58d8-932d-4e96-a911-4de41ed11715', '113cd498-f36e-4c82-b1cb-efe9a4df5a3a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:50 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:50 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:50 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-714dd018-9e05-43e0-88e5-d1371e008cfa-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-714dd018-9e05-43e0-88e5-d1371e008cfa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:51 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:51 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Deleted volume successfully. Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-6e514b6d-a0f0-4100-ae73-d95d04c26877 tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-47b8e42b-9b0f-4b20-9c0c-6fa893fb51a1-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "cinder-quobyte-714dd018-9e05-43e0-88e5-d1371e008cfa" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-714dd018-9e05-43e0-88e5-d1371e008cfa" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8366b66-3855-480a-b633-91a3000c7fca]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:52:51 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:51 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa Jul 03 17:52:51 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:52 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa" returned: 0 in 0.753s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:52 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa Jul 03 17:52:52 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:52 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-714dd018-9e05-43e0-88e5-d1371e008cfa" returned: 0 in 0.673s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-quobyte-714dd018-9e05-43e0-88e5-d1371e008cfa" released by "delete_volume" :: held 1.473s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Created reservations ['3522b81b-174d-489e-a3d6-1cb868810f26', 'c8d40654-a724-443b-99cc-39ec3bb851ef', '67c38413-784e-451a-b15d-7b511fbeb300', '19e5ffd8-1b9f-4c3a-a886-fa8e975920a2'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:52:52 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:52:52 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:52:52 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:52:53 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 03 17:52:53 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.654s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:52:53 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:52:53 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Deleted volume successfully. Jul 03 17:52:53 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-c07b1c7c-1b2d-466c-b5ca-d4a5d490c11b tempest-SnapshotDependencyTests-280841541 None] Lock "cinder-714dd018-9e05-43e0-88e5-d1371e008cfa-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:02 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:INSERT=10,cinder:UPDATE=63,cinder:SELECT=49,cinder:DELETE=4 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:53:03 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=44,cinder:INSERT=22,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (bbf79e12-474e-4aab-a021-a4edb735ff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60891f8-0b38-45b5-9a33-e6f084a8b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60891f8-0b38-45b5-9a33-e6f084a8b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191187355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd05092-6ac7-41ff-bee0-0eacdb0533c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:04Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca528dd8-a3aa-4851-82b2-1caf95f48967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca528dd8-a3aa-4851-82b2-1caf95f48967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641a2fa5-2dba-4e77-829f-fc2c7e1bf73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641a2fa5-2dba-4e77-829f-fc2c7e1bf73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd05092-6ac7-41ff-bee0-0eacdb0533c5', 'volume_name': 'volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1e13f0-7aae-46ff-9fcd-ea13550a5f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1e13f0-7aae-46ff-9fcd-ea13550a5f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e92d022-7539-451e-a3cc-236ad6944157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:04 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Volume 9cd05092-6ac7-41ff-bee0-0eacdb0533c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5', 'volume_size': 1} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191187355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd05092-6ac7-41ff-bee0-0eacdb0533c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:04Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Creating volume 9cd05092-6ac7-41ff-bee0-0eacdb0533c5 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:53:04 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:53:04 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:04 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 1073741824 Jul 03 17:53:04 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:05 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 1073741824" returned: 0 in 0.784s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:05 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:05 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 Jul 03 17:53:05 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:06 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5" returned: 0 in 0.640s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e92d022-7539-451e-a3cc-236ad6944157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36615186-9995-4c09-a870-ee545709d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:06 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Volume volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 (9cd05092-6ac7-41ff-bee0-0eacdb0533c5): created successfully Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36615186-9995-4c09-a870-ee545709d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (bbf79e12-474e-4aab-a021-a4edb735ff75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:06 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-3738434a-54c4-4889-9812-88058ea79811 tempest-ProjectReaderTests-398470129 None] Created volume successfully. Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-9cd05092-6ac7-41ff-bee0-0eacdb0533c5-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Lock "cinder-9cd05092-6ac7-41ff-bee0-0eacdb0533c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-quobyte-9cd05092-6ac7-41ff-bee0-0eacdb0533c5" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-9cd05092-6ac7-41ff-bee0-0eacdb0533c5" acquired by "delete_volume" :: waited 0.014s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadf5941-5da0-450d-b8f9-48f51cde1c00]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:53:06 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:06 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 Jul 03 17:53:06 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:07 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5" returned: 0 in 0.735s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:07 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:07 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5 Jul 03 17:53:07 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:08 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9cd05092-6ac7-41ff-bee0-0eacdb0533c5" returned: 0 in 0.609s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-9cd05092-6ac7-41ff-bee0-0eacdb0533c5" released by "delete_volume" :: held 1.378s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Created reservations ['cf1e7b9e-5e22-42e7-b9f4-3292546948d0', '4c950286-88b5-4650-820e-61981751099f', '5b9a0116-f67a-45fb-9110-95cdd5fac74a', 'a876ece5-77b6-4d59-bada-115683c70c92'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:08 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:53:08 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:08 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.623s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:53:08 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Deleted volume successfully. Jul 03 17:53:08 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-f86d00e1-a73a-4e7a-85b9-29e1685bd0bc tempest-ProjectReaderTests-398470129 None] Lock "cinder-9cd05092-6ac7-41ff-bee0-0eacdb0533c5-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (1c2e66b1-cc11-4213-8a1f-a20cc36019de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc09196-3ce3-4735-9a3e-320038bd525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc09196-3ce3-4735-9a3e-320038bd525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102338063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acc77a1-076f-4493-8f69-226aac8f2ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:09Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c16586f-8bcf-4ffb-83c6-a13dd7263472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c16586f-8bcf-4ffb-83c6-a13dd7263472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877c9611-eb79-4920-9172-aa0c5ae1c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877c9611-eb79-4920-9172-aa0c5ae1c839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1acc77a1-076f-4493-8f69-226aac8f2ac4', 'volume_name': 'volume-1acc77a1-076f-4493-8f69-226aac8f2ac4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f82176-fe1a-44e3-a1e3-3f1f01db3f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f82176-fe1a-44e3-a1e3-3f1f01db3f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cba0356-7a9d-4d15-bf4b-61e5857b0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:09 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Volume 1acc77a1-076f-4493-8f69-226aac8f2ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1acc77a1-076f-4493-8f69-226aac8f2ac4', 'volume_size': 1} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102338063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acc77a1-076f-4493-8f69-226aac8f2ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:09Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Creating volume 1acc77a1-076f-4493-8f69-226aac8f2ac4 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:53:09 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:53:09 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:09 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 1073741824 Jul 03 17:53:09 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:10 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 1073741824" returned: 0 in 0.787s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:10 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 Jul 03 17:53:10 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:10 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4" returned: 0 in 0.630s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cba0356-7a9d-4d15-bf4b-61e5857b0071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acc77a1-076f-4493-8f69-226aac8f2ac4', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd5fd0d-1e6f-4e5e-8216-e1fead788b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:10 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Volume volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 (1acc77a1-076f-4493-8f69-226aac8f2ac4): created successfully Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd5fd0d-1e6f-4e5e-8216-e1fead788b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:10 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (1c2e66b1-cc11-4213-8a1f-a20cc36019de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:10 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-df3b375b-c80e-4376-a8f4-10c708dc02cc tempest-ProjectReaderTests-398470129 None] Created volume successfully. Jul 03 17:53:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-1acc77a1-076f-4493-8f69-226aac8f2ac4-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Lock "cinder-1acc77a1-076f-4493-8f69-226aac8f2ac4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-quobyte-1acc77a1-076f-4493-8f69-226aac8f2ac4" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:11 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-1acc77a1-076f-4493-8f69-226aac8f2ac4" acquired by "delete_volume" :: waited 0.017s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:11 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2160f4-5b73-452a-a40a-aa5aabf68978]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:53:11 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:11 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 Jul 03 17:53:11 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:12 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4" returned: 0 in 0.727s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:12 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4 Jul 03 17:53:12 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:12 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:12 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-1acc77a1-076f-4493-8f69-226aac8f2ac4" returned: 0 in 0.623s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:12 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-1acc77a1-076f-4493-8f69-226aac8f2ac4" released by "delete_volume" :: held 1.393s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:12 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Created reservations ['f01a2b15-c8e3-4f47-b9ca-4af6a9b1d402', '1f112e1b-ca1c-40c5-93b0-d113ec4166c0', 'df9bc3db-24d6-4868-bf42-43d573f34cea', 'cb250122-5f15-4381-92c1-e62e350c2b4b'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:13 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:53:13 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:13 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:53:13 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Deleted volume successfully. Jul 03 17:53:13 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-ea050780-66b6-4439-bc3e-876178dde3ef tempest-ProjectReaderTests-398470129 None] Lock "cinder-1acc77a1-076f-4493-8f69-226aac8f2ac4-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (d460f5c0-75f7-441c-88d3-79685f2bd618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d7b4a9-acd9-41fe-ac60-ed01da972123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d7b4a9-acd9-41fe-ac60-ed01da972123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839203898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef23946-2f30-43cd-9ee6-0c7716b15738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:14Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d154b368-3c59-4c53-a0f7-60dac2153d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d154b368-3c59-4c53-a0f7-60dac2153d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f175b10-4f47-4d6f-b58b-3e1342759612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f175b10-4f47-4d6f-b58b-3e1342759612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef23946-2f30-43cd-9ee6-0c7716b15738', 'volume_name': 'volume-5ef23946-2f30-43cd-9ee6-0c7716b15738', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cff85a7-47f9-42fc-8515-7eb0f1143cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cff85a7-47f9-42fc-8515-7eb0f1143cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa83501c-8977-456e-99aa-82604431acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:14 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Volume 5ef23946-2f30-43cd-9ee6-0c7716b15738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef23946-2f30-43cd-9ee6-0c7716b15738', 'volume_size': 1} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-839203898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef23946-2f30-43cd-9ee6-0c7716b15738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:14Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Creating volume 5ef23946-2f30-43cd-9ee6-0c7716b15738 {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:53:14 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:14 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 1073741824 Jul 03 17:53:14 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:14 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 1073741824" returned: 0 in 0.769s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:14 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:14 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 Jul 03 17:53:14 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:15 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738" returned: 0 in 0.603s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa83501c-8977-456e-99aa-82604431acd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef23946-2f30-43cd-9ee6-0c7716b15738', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef625e6-41ef-4c7a-bbaa-852e5509441e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:15 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Volume volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 (5ef23946-2f30-43cd-9ee6-0c7716b15738): created successfully Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef625e6-41ef-4c7a-bbaa-852e5509441e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:15 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (d460f5c0-75f7-441c-88d3-79685f2bd618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:15 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-267d6665-309c-4af5-b6ee-f560e48e6fa0 tempest-ProjectReaderTests-398470129 None] Created volume successfully. Jul 03 17:53:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-5ef23946-2f30-43cd-9ee6-0c7716b15738-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Lock "cinder-5ef23946-2f30-43cd-9ee6-0c7716b15738-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-quobyte-5ef23946-2f30-43cd-9ee6-0c7716b15738" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:16 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-5ef23946-2f30-43cd-9ee6-0c7716b15738" acquired by "delete_volume" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:16 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c195044d-a348-4b7a-ad13-16e7f45a64f7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:53:16 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:16 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 Jul 03 17:53:16 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:17 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738" returned: 0 in 0.719s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:17 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738 Jul 03 17:53:17 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:17 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-5ef23946-2f30-43cd-9ee6-0c7716b15738" returned: 0 in 0.632s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-5ef23946-2f30-43cd-9ee6-0c7716b15738" released by "delete_volume" :: held 1.387s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Created reservations ['14d2ba4a-a66b-4834-8d5d-5727f08ff4eb', 'c6082f62-5202-4f30-ad74-788039cedbdf', '8f16dc80-85ac-42d4-85c8-72011a329c4a', '9b92177e-d3df-4698-b9a2-6c39e5f6cf1a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:17 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:17 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:53:17 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:18 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.612s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:53:18 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Deleted volume successfully. Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-cd5825ec-d6ba-4a69-9788-2c07b9c9eb4c tempest-ProjectReaderTests-398470129 None] Lock "cinder-5ef23946-2f30-43cd-9ee6-0c7716b15738-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (dd9996c6-2b42-437b-b33c-424cbbcb0656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdbf3b2-0b03-4215-b838-9683cb510815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdbf3b2-0b03-4215-b838-9683cb510815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862408384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de08e96-93f9-44d3-aa0f-dad1f9b753ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:19Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fce226-95aa-45a0-bc11-18ae0ed8257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fce226-95aa-45a0-bc11-18ae0ed8257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06c7ff0-b969-4e36-ace4-6d23d5ff5b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06c7ff0-b969-4e36-ace4-6d23d5ff5b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de08e96-93f9-44d3-aa0f-dad1f9b753ed', 'volume_name': 'volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbf99d5-ca45-4323-b093-3b0440b3e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbf99d5-ca45-4323-b093-3b0440b3e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9577a693-168e-4902-bd74-d8ca9016314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:18 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Volume 9de08e96-93f9-44d3-aa0f-dad1f9b753ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed', 'volume_size': 1} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T15:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862408384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de08e96-93f9-44d3-aa0f-dad1f9b753ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee47d44c2f034b658d610e92aa39f26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T15:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T15:53:19Z,use_quota=True,user_id='a75765d1bc9c456ebd9d037bb924f277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a0ee275-ccea-48db-aeb0-232776c54801),volume_type_id=0a0ee275-ccea-48db-aeb0-232776c54801)}" {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Creating volume 9de08e96-93f9-44d3-aa0f-dad1f9b753ed {{(pid=86621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Selected osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 as target Quobyte volume. {{(pid=86621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 17:53:18 devstack cinder-volume[86621]: INFO cinder.volume.drivers.remotefs [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] casted to osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092 Jul 03 17:53:18 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed 1073741824 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:18 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed 1073741824 Jul 03 17:53:18 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:19 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed 1073741824" returned: 0 in 0.783s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:19 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:19 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed Jul 03 17:53:19 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:20 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed" returned: 0 in 0.612s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'} {{(pid=86621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9577a693-168e-4902-bd74-d8ca9016314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed', 'volume_size': 1}' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae245c0b-1e7e-4461-bcd4-60b6b15371d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 17:53:20 devstack cinder-volume[86621]: INFO cinder.volume.flows.manager.create_volume [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Volume volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed (9de08e96-93f9-44d3-aa0f-dad1f9b753ed): created successfully Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae245c0b-1e7e-4461-bcd4-60b6b15371d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86621) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Flow 'volume_create_manager' (dd9996c6-2b42-437b-b33c-424cbbcb0656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86621) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 17:53:20 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-aa20b168-3dc0-479b-9ce1-0f8db62bfa4e tempest-ProjectReaderTests-398470129 None] Created volume successfully. Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-9de08e96-93f9-44d3-aa0f-dad1f9b753ed-delete_volume" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Lock "cinder-9de08e96-93f9-44d3-aa0f-dad1f9b753ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Acquiring lock "cinder-quobyte-9de08e96-93f9-44d3-aa0f-dad1f9b753ed" by "delete_volume" {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-9de08e96-93f9-44d3-aa0f-dad1f9b753ed" acquired by "delete_volume" :: waited 0.013s {{(pid=86621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 17:53:20 devstack cinder-volume[86621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e457fa2-d58c-4831-b8ce-72fd07977dc7]: (4, 'qcow2') {{(pid=87714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 17:53:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:21 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed Jul 03 17:53:21 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:21 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed" returned: 0 in 0.735s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:21 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:21 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed Jul 03 17:53:21 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:22 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69/volume-9de08e96-93f9-44d3-aa0f-dad1f9b753ed" returned: 0 in 0.626s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Lock "cinder-quobyte-9de08e96-93f9-44d3-aa0f-dad1f9b753ed" released by "delete_volume" :: held 1.396s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG cinder.quota [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Created reservations ['2b318ae5-56f3-4f05-9f9b-1e4a472e7cbd', 'b4aa5df6-cfed-4d47-85c8-a6619a62f9d0', '013ccdbb-2546-4c31-8549-878d579d0318', '76ce403b-5b06-44fe-8db9-89cf907a7e1a'] {{(pid=86621) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-86814ca3-954c-4a7f-a7a4-ad84341a0092'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 17:53:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 17:53:22 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69 Jul 03 17:53:22 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 17:53:23 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 03 17:53:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/022866bdb19f3069c9a0070ed8abcd69" returned: 0 in 0.633s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 17:53:23 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 17:53:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Deleted volume successfully. Jul 03 17:53:23 devstack cinder-volume[86621]: DEBUG cinder.coordination [None req-b1bd259c-54fc-4cdd-95c2-da4b6cdcffa8 tempest-ProjectReaderTests-398470129 None] Lock "cinder-9de08e96-93f9-44d3-aa0f-dad1f9b753ed-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86621) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 17:53:32 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:SELECT=31,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 17:53:33 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writing DB stats cinder:UPDATE=42,cinder:SELECT=25,cinder:DELETE=6,cinder:INSERT=7 {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}